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Abstract: A collection of IV-diffusing interacting particles where each particle belongs 
to one of K different populations is considered. Evolution equation for a particle from 
population k depends on the K empirical measures of particle states corresponding to the 
various populations and the form of this dependence may change from one population 
to another. In addition, the drift coefficients in the particle evolution equations may 
depend on a factor that is common to all particles and which is described through the 
solution of a stochastic differential equation coupled, through the empirical measures, 
with the A-particle dynamics. We are interested in the asymptotic behavior as A —► oo. 
Although the full system is not exchangeable, particles in the same population have an 
exchangeable distribution. Using this structure, one can prove using standard techniques 
a law of large numbers result and a propagation of chaos property. In the current work we 
study fluctuations about the law of large number limit. For the case where the common 
factor is absent the limit is given in terms of a Gaussian field whereas in the presence 
of a common factor it is characterized through a mixture of Gaussian distributions. We 
also obtain, as a corollary, new fluctuation results for disjoint sub-families of single type 
particle systems, i.e. when K = 1. Finally, we establish limit theorems for multi-type 
statistics of such weakly interacting particles, given in terms of multiple Wiener integrals. 
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1. Introduction 

For N > 1, let Z 1,N ,..., Z N,N be M d -valued stochastic processes, representing trajectories 
of N particles, each of which belongs to one of K types (populations) with the membership 
map denoted by p : {1,... , N} —>• {1,..., K} = K , namely z-th particle is type a if p(i ) = 
a. The dynamics is given in terms of a collection of stochastic differential equations (SDE) 
driven by mutually independent Brownian motions (BM) with each particle’s initial condition 
governed independently by a probability law that depends only on its type. The N stochastic 
processes interact with each other through the coefficients of the SDE which, for the z-th 
process, with p{i) = a, depend on not only the z-th state process and the a-th type, but also 
the empirical measures pj’ N = jj- J2j- P (j)= 7 7 € {1 and a stochastic process 

that is common to all particle equations (common factor). Here N. 7 is the total number of 
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particles that belong to the 7 -th type. The common factor is an m-dimensional stochastic 
process described once more through an SDE driven by a BM which is independent of the 
other noise processes. Such stochastic systems are commonly referred to as weakly interacting 
diffusion processes and have a long history. Classical works that study law of large number 
(LLN) results and central limit theorems (CLT) include McKean [14, 15], Braun and Hepp [2], 
Dawson [7], Tanaka [21], Oelschalager [17], Sznitman [19, 20], Graham and Meleard [10], Shiga 
and Tanaka [18], Meleard [16]. All the above papers consider exchangeable populations, i.e. 
K = 1, and a setting where the common factor is absent. Motivated by approximation schemes 
for Stochastic Partial Differential Equations (SPDE) the papers [12, 13] considered a setting 
where the common factor is modeled as a Brownian sheet that drives the dynamics of each 
particle. The paper [12] studied LLN and [13] considered fluctuations about the LLN limit. In 
a setting where particle dynamics are given through jump-diffusions and the common factor 
is described by another jump-diffusion that is coupled with the particle dynamics, a CLT was 
recently obtained in [3]. The fluctuation limit theorems in [13, 3], although allowing for a 
common factor, are limited to exchangeable populations. The goal of the current work is to 
study fluctuations for multi-type particle systems. Since these systems are not exchangeable 
(there is also no natural way to regard the system as a iL-vector of d-dimensional exchangeable 
particles), classical techniques for proving CLT, developed in the above papers [19, 18, 16, 13], 
are not directly applicable . 

Multi-type systems have been proposed as models in social sciences [5], statistical mechan¬ 
ics [4], neurosciences [1], etc. In particular the last paper [1], considers interacting diffusions 
of the form studied in the current work and establishes a LLN result and a propagation of 
chaos property. Our results in particular will provide asymptotic results on fluctuations from 
the LLN behavior obtained in [1]. Systems with a common factor also arise in many different 
areas. In Mathematical Finance, they have been used to model correlations between default 
probabilities of multiple firms [ 6 ]; in neuroscience modeling these arise as systematic noise in 
the external current input to a neuronal ensemble [9]; and for particle approximation schemes 
for SPDE, the common factor corresponds to the underlying driving noise in the SPDE [12, 13]. 
The goal of this work is to study a family of multi-type weakly interacting diffusions with a 
common factor. Our main objective is to establish a suitable CLT where the summands are 
quite general functionals of the trajectories of the particles with suitable integrability proper¬ 
ties. Specifically, in the case where there is no common factor, letting N a denote the set of 
indices i such that p(i) = a and 


V Q i&N a 

for functions (f> on the path space of the particles, we will establish (see Theorem 3.1) the 
weak convergence of the family (</>), </> E A ai a E K }, in the sense of finite dimensional 
distributions, to a mean 0 Gaussian field {f, a (4>), 4> E A a -,oi E K}. Here A a is a family of 
functions on the path space that are suitably centered and have appropriate integrability 
properties (see Section 3.3 for definitions.) In the presence of a common factor the centering 
term is in general random (a function of the common factor) and denoting by (</>) these 
suitably randomly centered and normalized sums of {(j)(Z l,N ),i E N a } (see (4.9)), we prove 
that under suitable conditions, {V^(<?!>), 0 € A a ,a E K}, where A a is once again a collection 
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of functions on the path space with suitable integrability, converges in the sense of finite 
dimensional distributions to a random field whose distribution is given in terms of a Gaussian 
mixture. 


CLT established in this work also leads to new fluctuation results for the classical single type 
setting. Consider for example the case with no common factor and suppose one is interested 
in the joint asymptotic distribution of (£j V ( 7 i), ^(</> 2 )), where 


LAiVj 


N 


*?(&) = 






yLV-LAiVj , = 


E M^ N ) 


|AJVJ+1 


and A € (0,1). Existing results on central limit theorems for K = 1 (eg. [18, 19, 16]) do not give 
information on the joint limiting behavior of the above random variables. Indeed, a naive guess 
that the propagation of chaos property should imply the asymptotic independence of £ 1 ^ 1 ) 
and £ 2 ^(^ 2 )) is in general false. In Section 3.4 we will illustrate through a simple example how 
one can characterize the joint asymptotic distribution of the above pair. 

We are also interested in asymptotic behavior of path functionals of particles of multiple 
type. Specifically, in the no common factor case, we will study in Section 3.6 the limiting 
distribution of multi-type statistics of the form 




1 

7m • • • n k 


E ••• E 

ilGJVi ik£N k 




( 1 . 1 ) 


where 0 is a suitably centered function on the path space of K x d dimensional stochastic 
processes with appropriate integrability. In the classical case (cf. [ 8 ]) where the particles have 
independent and identical dynamics, limit distributions of analogous statistics (with Ni = 
■ ■ ■ = Nk ) are given through certain multiple Wiener integrals (see Section 3.5). In the 
setting considered here {Z i,N y are neither independent nor identical and we need to suitably 
extend the classical result for U-statistics to a multi-type setting and apply techniques as in 
the proof of Theorem 3.1 to establish weak convergence of (1.1) and characterize the limit 
distributions. 


The central idea in our proofs is a change of measure technique based on Girsanov’s theorem 
that, in the case of single type populations with no common factor, goes back to the works [18, 
19]. For this case, the technique reduces the problem to a setting with i.i.d. particles and 
the main challenge is to suitably analyze the asymptotic behavior of the Radon-Nikodym 
derivative. In the multi-type setting (with no common factor), although one can similarly 
reduce to a problem for independent particles (however not identically distributed), the Radon- 
Nikodym derivative is given in terms of quantities that involve particles of different types and 
the classical results on asymptotics for symmetric statistics [ 8 ] that are used in [18, 19] are 
not directly applicable and one needs to suitably lift the problem to a higher dimensional 
space. For this, we first treat the easier setting where for all a, 7 € K, N a = 1V 7 so that 
under the new measure one can view the whole population as a collection of i.i.d. iGvector 
particles with k -th coordinate belonging to the /c-th type. We then extend the result to the 
setting where the number of particles of different types may not be the same. For proofs in 
this general case, the property that, under the new measure, the particles are independent of 
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each other together with classical results for multiple Wiener integrals, play an important role. 
Note that when N a = 7 € K , one can view {Z t,N } under the original measure as a 

K-vector of exchangeable particles. For this case one can apply results of [18, 19] to deduce 
a CLT. However it seems hard to use this result directly to treat the setting with different 
numbers of particles in different populations. One of the key ingredients in the approach taken 
in [18, 19] for the single type setting is to identify the limit of Radon-Nikodym derivatives in 
terms of a suitable integral operator. In the multi-type case (with no common factor) there is an 
analogous operator, however describing it and the Hilbert space on which it acts requires more 
work. Roughly speaking the Hilbert space corresponds to the space of i>-square integrable 
functions on the path space of K x 2d dimensional continuous stochastic processes, where 
£> = vi (g) • • • <S> vk and va for a € K is the limit law of processes associated with particles of 
type a. 

The setting with a common factor (see Sections 4, 6 and 7) presents several additional 
challenges. The factor process is fully coupled with the IV-particle dynamics in the sense that 
the coefficients depend not only on its own state but also on the particle empirical measures 
€ K}. Due to the presence of the common factor, the limit of will in general 
be a random measure. As a result, the centering in the fluctuation theorem will typically be 
random as well and one expects the limit law for such fluctuations to be not Gaussian but 
rather a “Gaussian mixture”. Our second main result (Theorem 4.2) establishes such a CLT 
under appropriate conditions. Proof proceeds by first considering a closely related collection 
of N stochastic processes which, conditionally on a common factor, are independent with 
distribution that only depends on its type. Unlike the setting with no common factor, there 
is no convenient change of measure under which this collection has the same law as that of 
the original collection of processes. We instead consider a change of measure, under which 
the distribution of the random centering remains invariant and one can view the distribution 
of a suitably perturbed form of the original vector of scaled and centered sums in terms of 
conditionally i.i.d. collections associated with the I\ types of particles. Asymptotics of this 
latter collection can be analyzed in a manner analogous to the no-common-factor case, however 
in order to deduce the asymptotic properties of the original collection, one needs to carefully 
estimate the error introduced by the perturbation (cf. Section 7.2). Once again, to identify 
the limits of the Radon-Nikodym derivative, integral operators on suitable L 2 -path spaces 
are employed. A new aspect here is that we need to first consider limit laws conditional on 
the common factor (almost surely), which are now characterized in terms of certain random 
integral operators. Finally, the description of the limit of the (un-conditional) Radon-Nikodym 
derivatives and synthesis of the limiting random field requires a measurable construction of 
multiple Wiener integrals with an additional random parameter (see Section 7.5). 

Central limit theorems for systems of weakly interacting particles with a common factor 
have previously been studied in [13, 3]. Both of these papers consider the case I\ = 1. The 
paper [13] establishes a fluctuation result for centered and scaled empirical measures in the 
space of suitably modified Schwartz distributions. Such a result does not immediately yield 
limit theorems for statistics that depend on particle states at multiple time instants (see [3] 
for a discussion of this point). In contrast the approach taken in [3], and also in the current 
paper, allows to establish limit theorems for quite general square integrable path functionals. 
Furthermore, the paper [3] sketches an argument for recovering the weak convergence of empir- 
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ical measures in the Schwartz space from the CLT for path functionals. Although not pursued 
here, with additional work and in an analogous manner, for the current setting as well one can 
establish convergence of suitably centered and normalized empirical measures {pp N , a € K} 
in an appropriate product Schwartz space. 

The paper is organized as follows. In Section 2 we begin by introducing our model of multi¬ 
type weakly interacting diffusions where the common factor is absent. A basic condition (Con¬ 
dition 2.1) is stated, under which both SDE for the pre-limit IV-particle system and for the 
corresponding limiting nonlinear diffusion process have unique solutions, and a law of large 
numbers and a propagation of chaos property holds. These results are taken from [1], For sim¬ 
plicity we consider here the case where the dependence of the drift coefficients on the empirical 
measures is linear. A more general nonlinear dependence is treated in Section 4. In Section 3 
we present a CLT (Theorem 3.1) for the no-common-factor case. As noted previously, this 
CLT gives new asymptotic results for a single type population as well. This point is illustrated 
through an example in Section 3.4. We also give a limit theorem (Theorem 3.3) for multi-type 
statistics of the form as in (1.1) in Section 3.6. Proofs of Theorems 3.1 and 3.3 are provided in 
Section 5. But before, in Section 4, we state our main results for the setting where a common 
factor is present. Specifically, Section 4.1 states a basic condition (Condition 4.1), which will 
ensure pathwise existence and uniqueness of solutions to both SDE for the Wparticle system 
and a related family of SDE describing the limiting nonlinear Markov process. Main result 
for the common factor setting is Theorem 4.2 which appears in Section 4.2. For the sake of 
the exposition, some of the conditions for this theorem (Conditions 6.1 and 6.2) and related 
notation appear later in Section 6. Finally Section 7 contains proofs of Theorem 4.2 and related 
results. 

The following notation will be used. Fix T < oo. All stochastic processes will be considered 
over the time horizon [0, T], We will use the notations {Xt} and {A(f)} interchangeably for 
stochastic processes. Denote by P(S) the space of probability measures on a Polish space 8 , 
equipped with the topology of weak convergence. A convenient metric for this topology is the 
bounded-Lipschitz metric dsL defined as 

dBL{v 1 ,^ 2 ) = sup G V(S), 

f 6B1 

where Bi is the collection of all Lipschitz functions / that are bounded by 1 and such that 
the corresponding Lipschitz constant is also bounded by 1, and (f,p) = J f dp for a signed 
measure p on § and /x-integrable function / : 8 —>• K. Let £>(§) be the Borel u-field on 8 . Space 
of functions that are continuous from [0, T] to § will be denoted as C§[0, T] and equipped with 
the uniform topology. For k € N, let Ck denote C R fc[0,T] and let ||/||*,t = sup 0<s<t ||/(s)|| for 
/ € Ck, t € [0, T]. Space of functions that are continuous and bounded from § to I will be 
denoted as <C&(§). For a bounded function / from § to M, let ||/||oo = sup xg § |/(x)|. Probability 
law of an 8 -valued random variable 77 will be denoted as C(rj). Expected value under some 
probability law P will be denoted as Ep. Convergence of a sequence {X n } of S-valued random 
variables in distribution to X will be written as X n =>■ X. For a er-finite measure v on a Polish 
space 8 , denote by L^ k (§, v) as the Hilbert space of zx-square integrable functions from S to 
M fc . When k and 8 are not ambiguous, we will merely write L 2 ( u). The norm in this Hilbert 
space will be denoted as || • ||x, 2 • Given a sequence of random variables X n on probability 
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spaces (Q n , F n ,P n ), n > 1, we say X n converges to 0 in L 2 (fl n , P n ) if f X 2 dP n ->0asn-> oo. 
We will usually denote by n, « 2 , • • •, the constants that appear in various estimates within 
a proof. The value of these constants may change from one proof to another. Cardinality of a 
finite set A will be denoted as |A|. For x, y G R d , let x ■ y = Yli=i x iUi- 


2. Model 


Consider an infinite collection of particles where each particle belongs to one of I\ different 
populations. Letting K = {1,... , 7T}, define a function p : N —>• K by p(i) = a if the i- 
th particle belongs to a-th population. For N G N, let AT" = {l,...,iV}. For a G K, let 
N a = {i e N : p{i ) = a} and denote by N a as the number of particles belonging to the 
a-th population, namely N a = |iV a |. Assume that N a /N —>• A Q G (0,1) as N —» oo. Let 
N q = {i G N : p(i) = a}. 

For fixed N > 1, consider the following system of equations for the M . d -valued continuous 
stochastic processes Z l,N , i € N, given on a filtered probability space (fi, F, P, {J 7 *}). For 
i € N a , a € K, 


ryi,N 

L t 


yi,N 

z o 



ds -{- 



( 2 . 1 ) 


where f a : [0, T] x ! d —>• M. d and b ai : x —>• W d are suitable functions, and p? s ' N = 

JT ^z : uN ' Here {W\i € N} are mutually independent d-dimensional {J^j-Brownian 

motions. We assume that {Z^ N : i € IV} are J r o~ measura ble and mutually independent, with 
C(Z'o' N ) = Pq for i £ N a ,a € K. 

Conditions on the various coefficients will be introduced shortly. Along with the IV-particle 
equation (2.1) we will also consider a related infinite system of equations for Revalued contin¬ 
uous stochastic processes X *, i € N, given (without loss of generality) on (0, F, P, {Ft}). For 
a G K and i € N a , 


XI 




(b aj (xi,-),p])ds+wi, 


( 2 . 2 ) 


where /r“ = C{X\). We assume that {Xq : i € N} are J^-measurable and mutually independent, 
with C(X q) = Pq for a £ K and i G N Q . 

The existence and uniqueness of pathwise solutions of (2.1) and (2.2) can be shown under 
following conditions on the coefficients (cf. [ 1 ]). 

Condition 2.1. (a) For all a G K . the functions f a are locally Lipschitz in the second variable, 
uniformly in t G [0, T]: For every r > 0 there exists L r G (0,oo) such that for all x,y G {z G 
R d : ||z|| < r}, and t G [0, T]: 


II fa{t,x) - fa(t,y) || < L r \\x - y||. 
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[b) There exists L E (0,oo) such that for all a E K, t E [0,T] and x E M. d : 

x ' fa(fi x ) < T(1 + ||^|| 2 )- 

(c) For all a, 7 E K, b ai are bounded Lipschitz functions: There exists L E (0, 00 ) such that 
for all (x,y) and ( x',y ') in W l x we have: 

\\b ai (x,y)\\ < L, 

II b ai (x,y) - b ai {x',y')\\ < L{\\x - x'\\ + ||y - y'||). 


The paper [1] also proves the following propagation of chaos property: For any ra-tuple 
(}i, • • •) ) e Nn > i !^ i 2 + • • • + *n. with p(*f) = atj, j = 1,..., n, 

C{{Z^ Z% > N }) -► y ai ® ® //“" as iV ->■ 00 , (2.3) 

in V(C2), where for a E /T and * E N Q , p a = £(X*) E V{C<i) and X 1 is as in (2.2). Using the 
above result and a straightforward argument similar to [ 20 ] one can show the following law of 
large numbers. Proof is omitted. 

Theorem 2.1. Suppose Condition 2.1 holds. For all f E C b{C d f), as N —>• 00 , 

_i_ f ( Z n,N } z i K , N) ^ < /; g,... g, (2.4) 

i 

where the summation is taken over all K-tuples i = (ii ,..., ipf) E N-± x • • • x N k . 


Note that Theorem 2.1 implies in particular that for all E C b(Cd) and a € K , as N ^ 00 , 

(2.5) 

" i£N a 

In this work we are concerned with the fluctuations of expressions as in the LHS of (2.4) 
and (2.5) about their law of large number limits given by the RHS of (2.4) and (2.5), respec¬ 
tively. Limit theorems that characterize theses fluctuations are given in Theorems 3.1 and 3.3. 
We will also establish central limit theorems in a setting where there is a common factor that 
appears in the dynamics of all the particles. This setting, which in addition to a common 
factor will allow for a nonlinear dependence of the drift coefficient on the empirical measure, 
is described in Section 4 and our main result for this case is given in Theorem 4.2. 


3. Fluctuations for multi-type particle system 

Throughout this section Condition 2.1 will be assumed and will not be noted explicitly in 
statement of results. 
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3.1. Canonical processes 

We now introduce the following canonical spaces and stochastic processes. Let Qd = Cd x Cy. 
For a E K, denote by v a E V^ly) the law of (W l ,X l ) where i € N a and X 1 is given by (2.2). 
Let v = v\ <8> ■ ■ ■ ® vk- Define for N E N the probability measure on as 

¥ n = C^W 1 , X 1 ), (IF 2 , A 2 ),..., (W^, X*)) = i/ p(1) ® ^ (2 ) ® ■ • • ® v p{N) , 

For ui = (uii,u} 2 , ■ ■ ■ , wjv) £ let F*(to) = u>i,i E AT. Abusing notation, 

W = (IF\JT), iGlV. (3.1) 

Also define the canonical processes V ,* = (IF*,X*) on as 

F*(w) = (W*(w),X*(w)) = (wi,w 2 ), w = (wi,co 2 ) € (3.2) 

3.12. Some integral operators 

We will need the following functions for stating our first main theorem. Define for a, (3,'y € K 
and t € [0, T], the function b ai j from x to as 

bay,t(x,y) = ba 7 (x,y)-(b a7 (x, ■),$), (x,y)eR d xR d . (3.3) 

Define for a, 7 E K , the function /i Q7 from x 0^ to R (y a ® zv 7 a.s.) as 

/a - f T 

h ai (u,d) = / b a ^ yt {X*,t(uj), A* jt (a/)) ■ dW M (w), (w, a/) E x (3.4) 

y W 4 o 

We now define /i/fed functions /i a7 , h from x to M (z> ® z> a.s.) for a ,7 £ K as follows: 

For w = (wi,..., ux) and u = (cjj,..., cc) 7 ) in , let 

K K 

h ai (u,J) = hcryiua,^), h(u,J) = ^ ^ fr Q 7 (oJ, J). (3.5) 

a= 17=1 

Now consider the Hilbert space 0). For a, 7 G K , define integral operators A a7 and 

^4 on £ 2 (!if ,0 as follows: For / E L 2 (Q^, z>) and u> E 

A on f{u)= [ h or/ (u/,u)f(u/) z>(du/), Af(u)= f h(u', u)f(J) v{dw'). (3.6) 

Jo.* 

It’s clear from (3.5)-(3.6) that A = J2a=i S 7 =i Avy- Denote by / the identity operator on 
L\a* , u). The following lemma will be proved in Section 5.1. 

K \ r T r 

Lemma 3.1. (a) Trace (A A*) = / / || 6 a7 t(X* t(w), X* t (a /))|| 2 u a {du)v 1 (du]') dt. 

1 A 7 -A) 

( 6 ) Trace(A n ) = 0 /or all n >2. (c) I — A is invertible. 
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3.3. Central limit theorem 

We can now present the first main result of this work. For a G K , let Lf.(Q.d^a) be the 
collection of 0 G L 2 (D^, u a ) such that <j}(u!)i/ Q (du) = 0. Denote by A a the collection of all 
measurable maps 4> : Cd —)• M such that <f> = G i/ a ). For (f> G A a , let ^(4>) = 

Yli£N a f>(Z l,N ). Given a G K and <f> G T 2 (Dd, u a ), define lifted function <fi a G L 2 (fl^ , z>) 
as follows: 

4> a (u) = <f>{u a ), u = (wi,... ,w K ) € fi*. (3.7) 

Theorem 3.1. (0) : 0 G *4. a ,a G FT} converges as N —» oo to a mean 0 Gaussian field 

{tiaifi) '■ <t> € ^4 a ,a G -RT} in f/ie sense of convergence of finite dimensional distributions, where 
for ct, 7 G -RT and f G A a ,fi G Ay, 

E[£a(0)6y WO] = (U - 

with <f> = (f>(X*), cj) a defined as in (3.7), and i /> 7 given similarly. 

Proof of the theorem is given in Section 5.2. 


3.4- -An application to single-type particle system 


Consider the special case of (2.1) where K = 1. Here, Theorem 3.1 can be used to describe 
joint asymptotic distributions of suitably scaled sums formed from disjoint sub-populations 
of the particle system. As an illustration, consider the single-type system given through the 
following collection of equations: 


ryi,N _ ryi^N . 

Z t — z o + 



f{s,Z : 


i.N\ 



Zf N )ds + Wfi 


i G N. 


(3.8) 


Suppose that we are interested in the joint asymptotic distribution of {£,1 (4>i), £,2 (fo)) f° r 
suitable path functionals <f\ and (f> 2 -, where 


£f(<M 


1 

7 H 


LA7VJ 

E *( zi,w ). 


i =1 



1 

y/N - |A1VJ 


N 


E 

i=[AiVJ+l 


A G (0,1). 


The propagation of chaos property in (2.3) says that any finite collection of summands on the 
right sides of the above display are asymptotically mutually independent. However, in general, 
this does not guarantee the asymptotic independence of and (<f) 2 ). In fact, one can use 

Theorem 3.1 with K = 2 to show that (£^(<^ 1 ), £2 (^ 2 )) converges in distribution to a bivariate 
Gaussian random variable and provide expressions for the asymptotic covariance matrix. We 
illustrate this below through a toy example. 

Example 3.1. Suppose Z l f N = 0, / = 0, T = 1, d = 1 and b(x,y ) = /3(y), where /3 satisfies 
Condition 2.1(2) with b ai replaced by (3. Further suppose that /3 is an odd function, namely 







/CLT for Multi-type Particle Systems 


10 


P(y) = —f3(—y) for all y E R. Due to the special form of 6, one can explicitly characterize the 
measure ;z,;, i = 1,2. Indeed, noting that for a one dimensional BM, {Wt}t£[ o.i], 


W t = 


\[ (/3,p s )ds + (l- X) f {/3,n s )ds + Wt, p s = £(W s ), 

Jo Jo 


we see that z/j = £(ID, ID) for * = 1,2. Consider for cu E Ci, 

faipo) = - J P(un)dtj, Ki € M, * = 1,2. 

Note that fa € M,; since P is odd, i = 1,2. For this example one can explicitly describe the 
asymptotic distribution of {£i (fa), £ 2 (fa)) by regarding (3.8) as a 2-type population with 
N\ = [_XAJ and N 2 = N — |_iV AJ. Following (3.5) and (3.7), define for oj = (uj\,uj 2 ) € f l? d , 


fa(u) = - J /3 (X^ t {Ui)) 


dt 


* = 1 , 2 , 


and for u' = (u \, oj' 2 ) E 


h(u',u) = 


,i(wi)) + VA(1 - X)p(X^ t (u 2 )) dID*, t K) 


+ j (v/A(l - \)P(X^ t (un)) + (1 - A)/3(X*, t (u; 2 ))) dW*,i(a/ 2 ). 

The operator X is then defined by (3.6). The special form of fa allows us to determine (7 — 
A) -1 fa, * = 1,2. Indeed, for w = (wi,w 2 ) € let 


= «i [Ah,i(cui) + jf 1 (v/A(l - A)/3(X*, t (u; 2 )) - (1 - A)/?(X*, t 
X 


dt 


</> 2 M = K2[x*a(uj 2 ) + (v/A( 1 - A)/9(X*, t (wi)) - A/3(X* >t 


dt 


Then 


#i(w) = f h(w , ,o;)'0 1 (a; , )i>(da;') = f (xp(X mjt (ui)) + V / A(l - X)P(X*j 

j j 0 

AV> 2 M = k 2 jT 1 (VA(1 - A)/3(X*, t ( Wl )) + (1 - A)/3(X* 


dt , 


This shows that t\) i = (7 — A)~ 1 cf> i for i = 1, 2. From Theorem 3.1 we then have that 
(^(^l );£2 ($ 2 )) converges in distribution to a bivariate Gaussian random variable (X,Y) 
with mean 0 and covariance matrix (oy/)i j=i, where 


hi = «?E [(Wi - (1 - A) £ p(W t ) dt) 2 + A(1 - A) ( J 0(Wi) 
^22 = k|e[(iDi-A J P(W t )dt) 2 + X(1- X)(J^ P(W t )dt ) 


dt 


2 i 


<712 = \/A(l - A)«ik 2 E 2IDi- / /3(Wt)dt) / /3(W*)di 


and ID is a one dimensional BM. 
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3.5. Asymptotics of symmetric statistics 

The proofs of Theorems 3.1 and 3.3 in Section 3.6 crucially rely on certain classical results 
from [ 8 ] on limit laws of degenerate symmetric statistics. In this section we briefly review these 
results. 

Let § be a Polish space and let {X n }fL 1 be a sequence of i.i.d. §-valued random variables 
having common probability law v. For k G N, let L 2 (y® k ) be the space of all real valued 
square integrable functions on (§ fc , £>(§)® fc , u® k ). Denote by L 2 (y® k ) the subspace of centered 
functions, namely (j) G L 2 (is® k ) such that for all 1 < j < k, 

[ <Kx 1 ,...,x j - 1 ,x,x j+1 ,...,x k )v(dx) = 0, I /®*- 1 a.e. (s,,..., x j+1 ,..., x K ). 

Js 

Denote by L 2 ym (v® k ) the subspace of symmetric functions, namely (j) G L 2 (i;® k ) such that for 
every permutation tt on { 1 ,..., k}, 

(j)(xi,...,x k ) = f(x n (v® k a.e. (xi,...,x k ). 

Also, denote by L 2 (v® k ) the subspace of centered symmetric functions in L 2 {y ® k ), namely 
L 2 csym {y® k ) = L 2 {v® k ) fl L 2 sym (y® k ). Given <f k G L 2 csyrn {v ® k ) dehne the symmetric statistic 
as 

{ ^2 MXii for n > k, 

l<il<i2<---<ik<n 

0 for n < k. 

In order to describe the asymptotic distributions of such statistics consider a Gaussian field 
{Ii(h); h G L 2 (z/)} such that 

E(h(h)) = 0, E {h(h)h(g)) = h,g G L 2 (u). 

For h G L 2 (is), define <$, G L 2 ym (y® k ) as 

< i> k (xi,-..,x k ) = h(xi) • • • h{x k ) 


and set </>q = 1 . 

The MWI of (j) k , denoted as I k {<f k ), is defined through the following formula. For k > 1, 

L fc /2J U 

h(<&) = £ (-lYC kj \\h\\% {lj) (h(h)f- 2 i, where C tJ = _ ^ . j = 0,..., [k/2j. 

(3-9) 

The following representation gives an equivalent way to characterize the MWI of 

oo ^2 

£j wife) = ex P (th(h) - —\\h\ Il2 (i/) ),t G M, 

k =0 
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where we set io(0o) = 1. We extend the definition of Ik to the linear span of {(t> k ,h E L 2 {y)} 
by linearity. It can be checked that for all / in this linear span, 

E(I k (f)) 2 = kl\\f\\l Hu0ky (3.10) 

Using this identity and standard denseness arguments, the definition of /&(/) can be extended 
to all / E L 2 ym (v® k ) and the identity (3.10) holds for all / E L 2 sym (v® k ). The following theorem 
is taken from [8]. 

Theorem 3.2 (Dynkin-Mandelbaum [8]). Let {(t>k}kLi be such that, for each k > 1, (f>k £ 
L 2 C S ym[ u ® k ) ■ Then the following convergence holds as n —>• oo: 

as a sequence o/M°° valued random variables. 


3.6. A limit theorem for statistics of multi-type populations 


In this section we provide a CLT for statistics of the form given on the left side of (2.4). 
Denote by L 2 (12^, v) the subspace of 0 E L 2 (Q^, v) such that for each a E K , 


/ 


0 (wi,... ,uk) ^((Ltt) = o, vi<g>- ■ ■ -®VK a.e. (wi,... ,w a _i,w a +i, • • • ,vk)- 


Denote by A h the collection of measurable maps 0 : Cjf —>• M such that (wi,..., ojk) 
0(wi, ■ ■ ■ ,ojk) = wi) ( • • • ,X*(uk)) € T 2 (Hff,i>). For 0 E A K and with {Z l ’ N } as in (2.1), 
let 

e Af (^ = 7 =i_ ••• E &«’*). (3.ii) 

^ 1 K iiGNi ik&N k 

We will like to study the asymptotic behavior of (4>) as N —>• oo. 

Let {Ik(h),h E L 2 ym (S k , v® k )}k>i be the MWI defined as in the previous section with 
§ = 12^ and v = z>, on some probability space (12, J 7 ,P). Recall h defined in (3.5). Define 
/ E L 2 (Qj x 12^, i> <S> 0) as follows: For (w, u/) E 12^ x 12^ 

f{oj,u)') = h{uj,uj') + h(oj',uj)— [ h(u>", u)h(uj",u') vfdu)"). (3.12) 


Define a random variable J on (12, J 7 , P) as 


J=-[h(f)-Tmce(AA*)}, 


(3.13) 


where A is as introduced in (3.6). For 0 E L 2 (12^,z>), define lifted symmetric function 0 Sy ™ E 
L 2 (( Ll I f) K , v® K ) as follows: For w- 7 = (cjj,... ,lo j k ) E 12 %,j E K , 

l s V m ( 12 A'\ 1 ,/ tt(1) tt(2) 

0 (w,w,...,w ) = 2^0( a, l > w 2 )> 


(3.14) 
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where the summation is taken over all permutations n on K . The following result characterizes 
the asymptotic distribution of (</>). 

Theorem 3.3. Ej,exp(J) = 1. Denote by Q the probability measure on (D,D) such that 
dQ = exp(J) • dF. Then for <fi € A K , C{f N [<f>)) -4 Qo as N —x oo, where 

4> = 4>{X* X*(-)) and 4> J is defined as in (3.14). 

Proof of the theorem is given in Section 5.3. 

Remark 3.1. In Theorems 3.1 and 3.3, the assumption that diffusion coefficients in (2.1) 
are identity matrices can be relaxed as follows: Replace Wf in (2.1) by fg X Q (s, Zp N ) dW l s + 
f*a a (s,Zl’ N )dW*, where X Q : [0, T] xR 11 -) M. dxd and cr a : [0, T] x R d —x R dxr are bounded 
Lipschitz (in the second variable, uniformly in the first variable) functions such that T, a is 
invertible and X” 1 is bounded. Here {W l ,i € AT"} and {W l : i € AT"} are mutually independent 
d and r dimensional BM respectively defined on (fl, J 7 , .P, {J}}). Proof of the central limit 
theorem under this weaker condition is similar except that the change of measure introduced 
in Section 5.2 takes a slightly different form. Specifically the function appearing in (5.5) 
and (5.6) (see (3.3)) is replaced by 

b ai ,t{x,y) = Yll(t,x)(b ai {x,y) - (b aj (x,-),f ij}), (x,y) e R d x R d , ct, 7 <E K, 

and {W\i € AT"} is replaced by {W l ,i € AT"}. However, to keep the presentation less technical 
we will assume diffusion coefficients to be identity matrices throughout. 


4. Weakly interacting particle systems with a common factor 

In this section we consider a setting where the drift coefficients of the interacting diffusions 
are suitable functions of not only the state of individual particles but also another stochastic 
process that represents a common source of random input to particle dynamics. Additionally, 
unlike Section 2, we consider a general nonlinear dependence of particle dynamics on empirical 
measures of particles of different types. 

For fixed N > 1, consider the system of equations for the R d -valued continuous stochas¬ 
tic processes Z l,N , i € AT", and the R m -valued continuous stochastic processes U N , given on 
For i € N a , 

Z\' N = zif N + f b a (Zi ’ N , U?, /O ds + Wl 

Jo 

U t N = Uo+ [ t b(U?,tf)ds+ f a{U^,^)dW 8 , 

Jo Jo 

N r 1 ,7V K.Ns 7,7V 1 r 

Ah =(JJ* )> A H = Jf 2^ d zf N - 

7 fG7V T 

Here (O, J 7 , P, (T)}), {W 1 } are as in Section 2, W is an m-dimensional {J;}-BM independent 
of {H 7 *}. We assume that for a € K, {Z\f N }ieN a are i.i.d. with common distribution //q and 


(4.1) 

(4.2) 

(4.3) 
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are also mutually independent. Moreover, Uq is independent of {Z^ N \i&N and has probability 
distribution /2 q. {Zq }i e jy and Uq are J- o measurable. 

We note that the model studied in Sections 2 and 3 corresponds to a setting where 

K 

b a {z,u,v) = ^(6« 7 (z, ■),is 1 ), is = (is i,... ,is K ) € [P(M d )]^, (z,u) € R d x R m . 

7=1 


As in Section 2, along with above IV-particle equations, we will also consider a related 
infinite system of equations for the Revalued continuous stochastic processes X 1 , i € N, and 
the R m -valued continuous stochastic processes Y, given on (12, F, P, {J 7 }). For a € K and 
i € N a , 

X\ = Xq + f b a (XlY s ^ s ) ds + Wl (4.4) 

Jo 

Y t = Y 0 + [ b(Y s ,n s )ds+ f a(Y s ,fi s )dW s , (4.5) 

Jo Jo 

= ihl • • •, T?), Ft = I™ TT" Y 5 x> ■ ( 4 - 6 ) 

iV->oo z ' t 

7 jeN y 

Here Yo = Uo and {AgligN are independent J-o-nreasurable random variables, with C(X q) = //q 
for i € Nq, and a £ K, and the limit in (4.6) is in a.s. sense. 


4-1- Well-posedness 

We now give conditions on the coefficient functions under which the systems of equations (4.1)- 
(4.3) and (4.4)-(4.6) have unique pathwise solutions. A pathwise solution of (4.4)-(4.6) is a 
collection of continuous processes (X*,Y'), i € N, with values in M. d x R m such that: (a) Y 
is {<5t}-adapted, where Qt = a{Yo,W s , s < t}; (b) X is {J^j-adapted where X = (Aj)j e pj; 
(c) stochastic integrals on the right sides of (4.4)-(4.5) are well defined; (d) Equations (4.4)- 
(4.6) hold a.s.. Uniqueness of pathwise solutions says that if (X,Y) and (X',Y') are two 
such solutions with (Xo,Yo) = (WqjEq) then they must be indistinguishable. Existence and 
uniqueness of solutions to (4.1)-(4.3) are defined in a similar manner. In particular, in this case 
(a) and (b) are replaced by the requirement that (Z l,N ,U N )i^N are {J^j-adapted. 

Define the metric on [V(R d )] K as dY](v, v’) = J2n=i d-BrA^a, v' a ) for is, is' G fP(R d )] K , 
is = (^ajogifi = (^a)aeKT- We now introduce conditions on the coefficients that will ensure 
existence and uniqueness of solutions. 

Condition 4.1. There exists L £ (0, 00 ) such that 

(a) For all x € R d , y € R m , is £ [^(R^)]^ and a € K, 

max{\\b a (x,y,is)\\, \\b(y,is)\\, \\d(y,is)\\} < L. 
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(b) For all x,x' G M d , y,y' G M m ; i/,i/ G [T^M^)]^ and a £ K, 

II b a (x,y,v) - b a {x',yf ,v')\\ < L(\\x - x'\\ + \\y - y'\\ + d ( ^(u,u')), 

II b(y,v) - Ky',v Oil + II- ^( 2 /, *011 < £(l|y - y'll + d^(u,u')). 

Under the above condition we can establish the following well-posedness result. The proof 
follows along the lines of Theorem 2.1 of [3] and is therefore omitted. 

Theorem 4.1. Suppose that 

j INI 2 Mo(^) + J \\y\\ 2 Mdy ) < oo 

a£K 

and Condition 4-1 holds. Then: 

(a) The systems of equations (4.4)-(4.6) has a unique pathwise solution. 

( b) The systems of equations (4.1)-(4.3) has a unique pathwise solution. 

Remark 4.1. (i) We note that the unique pathwise solvability in Theorem 4.1(a) implies that 
there is a measurable map U : M m x C m —» C m such that the process Y that solves (4.4)-(4.6) 
is given as Y = U(Y 0 , W). 

(ii) Recall that Q s = ct{Yq. W r ,r < s}, s G [0,T], Let Q = Qt- Then similar to Theorem 2.3 

of [12] (see also Remark 2.1 in [3]) we can show that if ({ X l },Y ) is a solution of (4.4)-(4.6) 

then 

y? = C(Xi\g) = £(xi\g t ),t G [0, T],i G N a ,a€ K. 

In particular, there are measurable maps 11“ : R m x C m —>• V(Cd) such that 11“ (Yq,W) = /t“ 
a.s., where y a = C(X l \Q) for a G K. Clearly yf is identical to the marginal of y a at time t. 


4-2. Central limit theorem 

The conditions and proof for the central limit theorem when there is a common factor require 
some notations which we prefer to introduce in later sections. In this section we will present the 
basic limit result while referring the reader to Section 6 for precise conditions and definitions. 

Recall f Id = Cd x Cd and let Q m = C m x C m . Define for N G N the probability measure P^ 
on (Cl N , where Cl N = il rn x f2^, as 

= £((W, Y), (W\X 1 ), (W 2 ,X 2 ),..., ( W N , X N )), (4.7) 

where processes on the right side are as introduced below (4.3). Note that P^ can be disinte¬ 
grated as 

F N (dtiduJi ■ ■ ■ dujjy) = p p ( 1 )(tu, dcji)/3 p ( 2 )(w, dw 2 ) • • • p p ^ N )(ui,dw N )P(dO), 

where P = £(W,Y) and for a G K. p a (0,duj) = U a ((CoQ^Co 1 ))(duj) for P a.e. Co = (a; 1 ,a) 2 ) G 
Cirri' 
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We can now present the second main result of this work. Recall X * introduced in (3.2). 
For a £ K, denote by A a the collection of all measurable maps 4> : Cy —» R such that 
4>{X *) £ L 2 (£ld, Pa(&, •)) f° r P a - e - ^ € Q m . For </> G and u) € G m , let 

m2(u) = f 4>(X^(uj))p a (u,doj), (4.8) 

Jn d 

vzw = E - n W °))> ( 4 - 9 ) 

“ ieiv a 

where F° = (IT, F). For cf> a £ .A a , a £ K, let tt n ... ,(J)k) € P(M A ) be the probability 
distribution of (Vf^^i),..., V^(4>k))- For Q £ fi m , let vr^(0i,..., 4>k) be the it'-dimensional 
multivariate normal distribution with mean 0 and covariance matrix = (X^ 7 ) a)7g x intro¬ 
duced in (6.6). Let 7r(0 i,..., 4>k) £ V(R K ) be defined as 

tt(0i,... Ak) = f ... ,4> K )P(du). (4.10) 

The following is the second main result of this work. The proof is given in Section 7. 

Theorem 4.2. Suppose Conditions 4-1, 6.1 and 6.2 hold. Then for all a £ K and (b a £ A a , 
ir N {4> i,.. •, 4>k) converges weakly to ir(<j)i ,..., 4>k) as N —>• oo, where ..., ^>x) G P(M A ) 
is as in (4.10). 

Remark 4.2. (i) We note that unlike in Theorem 3.1, there is a random centering term 
m. 0 Q (F°) in the limit theorem (cf. (4.9)). Also, as seen for the definition of it in (4.10), the 
asymptotic distribution of V A (cj) a ) is not Gaussian but rather a mixture of Gaussian distribu¬ 
tions. 

(ii) One can also establish a result similar to Theorem 3.3 for the setting with a common factor. 
We leave the formulation and proof of such a result to the reader. 

Organization of the paper: Rest of the paper is organized as follows. In Section 5 we prove 
Lemma 3.1, Theorems 3.1 and 3.3. These results concern the setting where there is no common 
factor present. Proof of Lemma 3.1 is in Section 5.1 while Theorems 3.1 and 3.3 are proved in 
Sections 5.2 and 5.3 respectively. Sections 6 and 7 treat the setting of a common factor described 
in Section 4. In Section 6.1 we will introduce the main assumptions, Conditions 6.1 and 6.2, 
needed for Theorem 4.2 and Section 6.2 - 6.3 will introduce some functions and (random) 
integral operators that will be needed in the proof of the theorem. Proof of Theorem 4.2 and 
also the proof of Lemma 6.1 will be presented in Section 7. 


5. Proofs for the no-common-factor case 

For N £ N, let P iV , 14, V 1 ,i £ N,i/ a ,a £ K,P be as in Section 3.1. 
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5.1. Proof of Lemma 3.1 


Recall the definition of b aiit , h ai and h in (3.3) and (3.5). Define for a, /3 ,7 € K, the functions 
b a p lt t : R d x R d —>• M and / Qi( g 7 from x to M (up <g> u^ a.s.) as follows: 


bafa , t (x,y) = I b a/3}t (z,x) -b a ^t(z,y) p?(dz), (x,y)€R d xR d , 


(5.1) 


f T 

) — / / b a py i t(X* ! f(u}'), )) dtj (uj,uj ) £ Dd x (5.2) 

Y / ^/3 / ^7 «/ 0 

Also define lifted function l a j g 7 from x to R (z> ® £ a.s.) as 

4k,/ 37(^1 = ^a,/3'y( UJ /3, w 7 ), w = (aq, • • •, wr-) £ , u/ = (cu(,..., u;^-) £ . (5.3) 

It is easily seen that for a, c/,/?, 7 € K, 

/ h a p(u",u)h a ' y (u",u’) v((k}") = 1 {a=a , } i a ^(ui,J). 


(5.4) 


Recall the definition of the integral operator A „ 7 for a, 7 € RT in (3.6), and note that its 
adjoint A * 7 : L 2 (Q ^, 0) —> L 2 (flff, u) is given as follows: For / £ L 2 (Qff, u) and ui £ , 


A* ai f(uj) = / h ai (u,J)f(d)v(du)'). 

J 


Then for a, a', /?, 7 € K, the operator A a pA * a , : L 2 (Q^,u) —> L 2 {fl^,v) is given as follows: 
For / £ L 2 (fl^, v) and w £ 


A a pA* Q/l f(u)) = / (/ h h a p(J ,J')u(du')jf(Lo'')u(duj'') 

= l{a=a'} [ L,0'y(u,u")f(uj")l'(duj"), 

where the last equality follows from (5.4). In particular, A a pA* a , = 0 if a 7 ^ ah Moreover, for 
a, 7 , 7 ' £ RT, 

Trace(A Q 7 A* 7 ,) 

= / h a y(oj,oj')h ai (oj,oj') u(duj) u(du') 

■fnfxnf 

= 7== [ [ b a y t (X* t (u a ),X* t (u>',))-b a ^t{X*,t(uj a ),X* t (u;'))dti>(duj)t'(duj') 

VV4 Jo 

||&Q 7 ,t(^*,t(w), A'* i t(w , ))|| 2 u a (duj)u y (du') dt. 


\ cT 
A, 


i{ 7 '= 7 }. 

/ '7 JO JOrfXOd 
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In particular, Trace(A a 7 A* ,) = 0 if 7 / 7 '. Hence we have 

K K K K I\ K 

Trace(AA*) = Trace ((EE^>(EE^)*) = EE Trace(A a 7 A* 7 ) 
a=l 7=1 a=l 7=1 a=l'y=l 

K 'jp 

= V - / / ||6 Q , 7i f(X* it (o;),X* it (u; , ))|| 2 t / a(da;)i/ 7 ((iw')di, 

a i7= i /X 7 JO Jn d xn d 

which proves part (o) of Lemma 3.1. Noting that 

Trace(A n ) = / h(u>i, uj 2 )h{u> 2 , W 3 ) • • • h(uj n , uJi)C'(duj\)i'{duj 2 ) ■ ■ ■ z>(dw n ), 

Jnfxnfx-xnf 

part ( 6 ) follows from the proof of Lemma 2.7 of [18]. Part (c) is now immediate from Lemma 1.3 
of [18] (cf. Lemma A.l in Appendix A). □ 


5.2. Proof of Theorem 3.1 


Recall the canonical processes X i ,W i ,V i and probability measure P N introduced in Sec¬ 
tion 3.1. For t € [0, T], define 


J N {t) = J N ’\t) - - 


where 


and 


J V ' 1 (‘) = E E f'tw E 

a=li£N a J0 7=1 7 jGAT-y 

rt K 


XI) • dlR 


j" J (t)=EE /'||Ejf E wrewD 

a=l i£N a 7=1 7 jeA 7 


ds. 


(5.5) 


(5.6) 


Let J 7 /^ = cr{R*(s),0 < s < t,i € IV}. Note that (exp (^(t))} is a {Ty 7 [-martingale under 
W N . Define a new probability measure Q N on by 




dF N 


= exp {J n (T)). 


By Girsanov’s theorem, (A" 1 ,... ,X N ) has the same probability distribution under Q N as 
(. Z 1 ’ JV ,..., Z N ' N ) under P. For cj)£A Q ,a£K, let 

S'w-vfeE#*)- 


i£N a 


Thus in order to prove the theorem it suffices to show that for any (p^ € A a , a € K. 

1 .-_i 7(a) 2 

t 

aaK ' ' a&K 


^lim E q „ exp (i 2 g (*<“>)) = ^ (-!]](/ - ^l)" 1 E tf’Lnf J 


L 2 {nf,0); 


(5.7) 










/CLT for Multi-type Particle Systems 


19 


where as in Section 3.3, <j>^ = and ' s defined by (3.7), replacing 4> with </>(“). 

This is equivalent to showing 


lim E p jv exp i 
TV—>-oo 


1 -IV ,2 


(*E^ (a) ) + jJV,1 ( T )-2 J 




= exp 


(/-A)' 1 £ 0, 


(a) 

a 


aeK 


2 

L2(Qf,P) 


(5.8) 


In order to prove (5.8), we will need to study the asymptotics of J N ^ and J N,2 as IV —>• oo. 
The proof of (5.8) is completed in Section 5.2.3. We begin by studying a generalization of 
Theorem 3.2 to the case of K populations. 


5.2.1. Asymptotics of statistics of multi-type populations of independent particles 

Throughout this subsection, let {H 1 = (H{, W 2: ..., l be a sequence of i.i.d. -valued 

random variables with law 5 = We introduce the following notion of lifted functions 

and lifted symmetric functions. Given a ,7 € K and t/> a<y € L 2 (Fld x Fid,fa < 8 > zz 7 ), define t /) a7 

and t /> Q7 in L 2 (fl^ x Flf, u ® u) as follows: For oj = (uq, ... ,ojk) and u' = ( a / l5 ... ,oj' k ) in 

()/' 
lL d 1 

^ 07 (w, w ) = ^ a 7 (w a , W 7 ), -0 Q7 (w, w ) = - ^ Q 7 (w, W ) + , w)J. (5.9) 

Recall 0 S ' y,,, € L 2 {{Fl ^) K , ) defined in (3.14) for 0 € L 2 (Q^ ,z>). 

Recall the definition of L 2 (Fld,f a ) and L 2 (Fl^,i>) in Section 3.3 and 3.6, respectively. Also, 
for a, 7 € IT, denote by L 2 (Fld x 27 * < 8 > v 7 ) the subspace of 0 G L 2 (Fld x 17 * < 8 > 17 ,) such 
that 

/ if(io',io)n a (dut') = 0 , z / 7 a.e. to and / 0 (to, u/) z/ 7 (cL/) = 0 ,z^ Q a.e. to. 

The following lemma gives asymptotic distribution of certain statistics of the IT-type popula¬ 
tion introduced above. 

Lemma 5.1. Let (0 Q , *p ai , <f : a, 7 € IT} 6 e a collection of functions such that, <f> a € 
L 2 (Qd,Va) for each a € K, iP ai € L 2 (Qd x Fld,v a < 8 > zz 7 ) /or eac/i pair of a, 7 € IT, and 
<f> € L 2 (Qj, 0). For each iVeN, /et 

C A = (Ci^CfiCl^Cf), V = iVi,V2,V3,m), 


1 ^ 

1 * 


C 2 ^ 


cf 


1 N 

*l,...,ur=l 


where 
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and 


m = (h($a))i = V = (/2(C‘)): = , % = (/2(C7))l<a^<K> ^ = 1^"'). 

Here {Ik}k> 1 are as defined in Section 3.6. Then ( N ^ p as a sequence ofW valued random 
variables, as N —>• oo, where q = K + K + K(K — 1) + 1. 

Proof. Note that for a € AT, we have 

I N i w 

Tvf XI = 77 = X )> 


~sym .K 


Vn t 


2—1 

1 X - , 2 




JV 


X 


N 




1<2^j<AT l<i<j7 < AT 

Also, for a, 7 € AT such that a / 7 , we have 

, » 9 | Ar 


7Y T Q 7 v a 1 7' jy TQ 7 ^ ’ N 

i,j =1 1 <i<j<N 1 = 

Let 5 = {( 21 ,..., ix) € 1V A 2 ^ are distinct}. Then we have 

1 N 

nm E W.-.-h: 


n k / 2 

i 

= ivA/2 


4*; 


n,-..,*x=l 




Ad 

iV^/2 


E 


X sym (Tjn 


1 




l<ii<---<iK<N 

Combining above results gives us 




C N = C N + n N ^ = (C7c 2 7c 3 7cf) + (0A'xi,02,xiX v ’ i X v ’ 1 ) ) 


iV,l ^JV.lx 


(5.10) 


where 


^ = (^EA(w'))E> ^ N = (v E *r(H-,i27)E. 


1 <i<j<N 




cf = 






AT! 


E 


X sym run 






1 w 






i =1 


1K\ 

K )■ 




and 
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From Theorem 3.2 it follows that as N —>■ oo, 

C N => V- (5.11) 

By law of large numbers, we have F^’ 1 —> 0#rK_i) x i in probability as N —>• oo. Note that as 
N —» oo, 

= E o, 

since |JV*\,S| = N K - JV(JV - 1 ) ■ ■ ■ (N - K + 1 ) = o{N K ). Hence 

n N ’ 1 0, xl (5.12) 

in probability as N —> oo. The desired result follows by combining (5.10), (5.11) and (5.12). □ 

For studying the asymptotic behavior of J N)1 and J N ’ 2 , we will need an extension of 
Lemma 5.1 to a setting where the numbers of particles of different types may differ. Be¬ 
fore discussing this extension, we present an elementary lemma, the proof of which is given in 
Appendix B. 

Lemma 5.2. For m,n = 1,2,..., let £ mn , £ n be M. d -valued random variables defined on some 
probability space (flo,.Fo,Po), and rj m ,r) be W l -valued random variables defined on some other 
probability space (fig, J-^Pg). If for each m > 1, f mn => r] m as n —>• oo and the following 
condition holds: 

lim supEn» 0 (||£ mn - £ n || A l) = 0, lim E P / (||?? m - r)\\ A l) = 0, 

m—>-oo n >i ra—>•oo u 

then => 7 / as n —> oo. 

We now study the following extension of Lemma 5.1. 

Lemma 5.3. For a £ K, let N a be a function of N such that limjv^oo N a = oo. Let 
{fi a , V’cry, 0, a , 7 € K}, 77 and q be as in Lemma 5.1. For each N £ N, let 

s N = 


where 


£f = 


I ^Q! 1 _^ 

e" = (]v- E 

V a i= 1 " l<i^7<iV„ 


a=l ’ 


1 A/» W 

V iV « iV 7 j=i j=l 




E = 


Ah Afa 


, E ••• E <kE\--->Ee 
vm • • ■ % E E 1 K 

zi = l Z1C = 1 


T/ien f N ^r]asa sequence o/M 9 valued random variables, as N —>• oo. 








/CLT for Multi-type Particle Systems 


22 


Proof. For each /3 = 1,..., K, let {ln d , e^, e^,... } be a complete orthonormal system (CONS) 
in L 2 (Od,z/g). Note that ((f) a , fn d ) L 2 (p. d ,v a ) = 0 for all a E K , and analogous orthogonality 
properties with the function l^ d hold for -0 Q7 and <f >, for all a, 7 € K. (For example, {xf a ^, lo d < 8 > 
e 7 )L 2 (n d xSl J , 1 / a ® i / 7 ) = 0 for all a, 7 E K and j > 1). Because of this, ->• xf ai in L 2 (Q d x 
fi d , t'a < 8 > V'y) and (f) M —>• (f) in L 2 (Q^ , u), as M —>• 00 , where 
M M 

<(^^')= E E ^ mi C(^)^(w'), (w,w')€fi d xfi d , a, 7 €K, 

m Q =l m 7 = l 

Af M 

0 M ( W i,...,<*,*) = E •" E c mi - mif er i ( Wl )- e r(a; if ), (07, - - -, u K ) € fif, 

mi = 1 mx=l 


andc ” 7 = (V , a 7 ,C a '® e 7 lT )i 2 (o d xn= ( 0 ,e™ 1 ®---<g)e’£*) L 2 (n Ki >) . It follows 

that as Af —> 00 , -0 a7 ’ y —> i/)^ T in L 2 (fl^ x 0) and </> —t<j> in L 2 ((Q^) K , v® K ). 

For M, N E N, let 


C MN _ ( C N C 1M C 1V1N C MN\ JVl _ / „ M A1 \ 

S — (s 1 • S2 : S3 " S4 )i V — C/E 72,7.3 i 74 ), 
where £^ /Ar are defined as C> ¥ , ^ but with and (f) M instead of if) and <p, and 


M t t t 7 M ^y m \\ 

Vs = [H'l’cn )) 


M T rl M ’ s y m \ 

74 = Ik{4> ) 


l<a/7<K 5 

From Lemma 5.2, in order to finish the proof, it suffices to check the following three properties 
hold: 


lim sup E||£ MJV - r f = 0, lim E|| 7 M - rj\\ 2 = 0, f 

M —>00 tv >1 M —>00 


MN 


r] M as N —>• 00 . (5.13) 


Note that the first two coordinates of ^ IN and rj M are the same as those of £ N and 7 , 
respectively. So for the first two statements in (5.13), we only need to check for the third and 
last coordinates. Consider the first statement. 

lim supE(tf™-tf ) 2 

M—kx> jv >1 


= lim sup 


1 


JVl 


Nu 


M —>00 tv >1 ■ ■ ■ Nk 


E-E .., H)f)Y 


*1=1 i K =1 


= lim E(0 m (^ 1 1 , ..., H l K ) - 4>{H\ ,..., Lf|0 ) 2 = 0. 

M—>■ 00 


Similarly, for each pair of a, 7 E FT such that a 7^ 7, 

JV a Jv 7 


1 


JVa JV 7 


lim sup E _ 

M^ooAr>i V ^N a N^ “ “ 


E E ^7) - —/ww E E #?)) 2 = 0 


y/N a N y , =1 


This proves the first statement in (5.13). Recalling the isometry property of MWI (3.10), we 
have for each pair of a, 7 E RT such that 7, 


lim E 

Af—> 00 


(wf 7 ’ 


M ’ S 2 /m )-^ 2 (C 7 m )) 2 = lim 2 


M—>oo 


7 M,sym fsym 2 

^a 7 - *l>, 


o.'y 


L 2 (Q*f x Q 7,£>(g>*>) 


= 0 . 
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Thus the second statement in (5.13) holds with r] M and rj replaced by rj and 773 , respectively. 
Similarly, for , we have 


lim E(r/ 4 ^ — 7 / 4) 2 

M—>-oo 


lim K\ 

M—> 00 


4> 


^sym. 

<t> 


2 

L 2 ((n$) K ,6® K ) 


Combining the above observations, we have the second statement in (5.13). 

Finally we check the third statement in (5.13). Let € L 2 (v a )}^ L 1 be K mutually 

independent Gaussian fields such that 


E(/?(/*)) = 0, E(/f(li)/f( 5 )) = (h,g) L 2 {Ua) for all h,g € L 2 W,a 6 K. 


Let fj M = (fji, 7)2, fj^ , 7)4^), where 

M M 

>)? = (EE 

m a = l m 7 = l 
M M 

«*'= E ••• E ( 4 *). 

mi=l tyik = 1 


and If is as defined below (3.9) by replacing /1 there with Theorem 3.2 and mutual 

independence of : i = 1,..., N a ,a = 1,..., K} imply that for each M > 1, as N —>• 00 , 
^MN ^ ~M. 


In order to verify the third condition in (5.13), it now suffices to show rj M and p AI have 
the same probability distribution. However, this follows easily by considering the asymptotic 
behavior of 


^MN _ ^ qN qN qMN 

where C,^ and (2 are as in Lemma 5.1, and Ci^ N [resp. (£ IN ] are also as in Lemma 5.1 but 
with ijj [resp. (f)\ replaced with [resp. <f) M ]. Once more by Theorem 3.2 and mutual 
independence of {H l a : i = 1,..., N a ,a = 1,..., A'}, we get as N —>• 00 , ( MN =>■ fj M . On the 
other hand, Lemma 5.1 implies that as N —>• 00 , f MN => ■ Combining these observations, 

we see that fj M and r/^ 1 have the same probability distribution, which finishes the proof. □ 


5.2.2. Asymptotics of J N 

Recall the definition of J N)l , V 1 , h ail h ai and h in (5.5), (3.1), (3.4) and (3.5) respectively. All 
convergence statements in this section are under ¥ N . It follows by law of large numbers that 
for a € K. as N —>• 00 , 


1 

N,a 


E 


i€N a 


KaiV^V 1 ) 


h aa (uj , oj) iy a (duj) = 0 . 
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By Lemma 5.3 and the above result, we have the following convergence as IV —>• oo: 

J N '\T) = rflwT, K-,,t(x},xi) dwi 

a=UeN a Jo 7=1 7 ieiv-v 


i=l ieNa. " “ 7= 

/ A 7 lV a 1 


/^E E h ai (V\Vi) ^ I 2 (h sym ), 

a= 1 7=1 V AaiV T' V iV « iV 7 lGA T a jelV 7 

where h sym is defined as in (5.9) with z/> replaced by h. 

Recall the definition of J ^’ 2 in (5.6). We split J N,2 as follows: 


a: 


a: 


A' 


^ 2 m = E EEESE 

a=l ieNa /3=1 jelVa 7=1 fcelV 7 
5 , -j 1 


b a/ 3 , t (XlXi)-b ai , t (Xl,X?)dt 


NpN-f Jq 

EE ehyT f KpMlxl) • b ai ,(xi,xl)dt = y% N , 


n=l 5, 


n=l 


where <Si, S 2 , £ 3 , S 4 and S 5 are collection of (a, f5 , 7 ) € K ’ and (i,j, k ) € x IVg x TV 7 such 
that (z = j = k}, {i = j ^ k}, {i = k 7 ^ j}, {j = k ^ z} and {z, j, k distinct}, respectively. For 
the term 7}^, from the boundedness of b a p t t it follows that as N —>• 00 , 


K j' 

^EiE / ||6 aQ , t (^,X*)|| 2 

a=l ^ *eiv a ■ /o 


dt =>■ 0 . 


For 72 , let <S a7 = {(z, &) € N a x iV 7 : z 7 ^ A;} for a, 7 € iF. Then 
K ^ 


% N = y —E y 

^ real ^ 


b aa ,t{Xt,X ' t ) • b aj , t (XiX?) dt = y + 7$, 


-JV . t-AT 


a,7 : 


= 1 “ 7 (i,fc)e5 Q 


where 


K 

T 7 =E 


1 


E 


2,1 <= N a N~ — 

“,7=1 7 (i,k)eS a 



b aa , t (Xl,Xl)-b a ^ t (Xi,X?) 


I lid 

converges to 0 in L 2 (fl^ r ,P 7V ) as N —> 00 , and 

K” „T 


I (cj), (^)) ^a7,t (^)j )^ / a(^-0) dt 


T£= e 


1 


E 


' ■“ NQ,Nry ‘ — /Q /O 

a, 7=1 7 (2,/c)g5 Q7 170 



bac£,t (^)j * ^ 0 : 7 ,t(^) 5 Xj .) iSfx^duj') dt =$* 0 


by the law of large numbers. Hence 7^ => 0 as IV —>• 00 . Similarly 73 JV =>■ 0. Consider now T£ 


■N 


-N 
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where 


b ai AXlX, 


i vk\ i |2 


\\b ai , t {X^(uj),X k )\\ 2 u a (du; 


T &=Y.jp £ l 

a,7=1 7 {i,k)GS a -y JU 

- [ ||&a 7 ,t(y,X*,i(u ;))|| 2 i/ 7 (dw) + f ||&a 7 ,t(Xyw),X M (u /))|| 2 v a (du)v~/(duj')) dt 

Jn d Jn 2 d / 

converges to 0 in L 2 (f]^,P jV ) as IV —>• oo, and 

rp 

% N 2 =£4 E [ ([ IK^A^Xhfvaidu) 

«,7=1 N -y d,k)es a j° 

+ [ \\b ai ,t{Xl,X*f{u ))\\ 2 v^dui) - f \\b ait t(X* t t(uj),X*j(u '))\\ 2 Vaidujv^iduj')) dt 

Jill 1 


K 

E V" [ [ \\ba^t(X*,tH,X*,t(^))\\ 2 dt = TYace(jL4* 

a i7= l 7 JO Jil d y.il d 


) 


as iV —>• oo, by the law of large numbers and Lemma 3.1. So => Trace(ZZ*) as N —>• oo. 
Finally consider 7^. Let S Qf 3 7 = {( i,j,k ) € -ZVq, x IVg x 1V 7 : i,j,k distinct} for a,/ 3,7 € Ff. 
Recalling the definition of b a g 7; t in (5.1), we have 


'7~TV _ 

7 5 — 


where 


E RfV E [ T b af} , t (Xi,xi)-b oer , t (X' t ,X*)dt= (^ 7 ,i + ^ 7 , 2 )> 

Q:,/3,7= 1 


s-fN _ 

7 a/37,l 


JVflJV- S J 
P > u «■ ^ 




,t{ x l X t) • b a ^t(Xl,X t k ) - b a ^ t (Xl,X t k ) dt 


converges to 0 in L 2 (fl^ r ,P iV ) as IV —>• oo, and 


'- 7 -TV _ 

7 q;/37,2 


^^7 


T 

E [ KfP,,A X l X t)dt. 

,77 jo 




Recall the definition of Z a ^ 7 and ^ Qii a 7 in (5.2) and (5.3) respectively. By Lemma 5.3, we have 
the following convergence in law. 


io 




lim y 77L 2 = lim E 




TV—>-00 


a ?/ #, 7 =l 


TV—>-00 NffNsy 

«,/3,7=l 7 (j,k)eSp. 


r 1 

L l 


b a ^ t (xi,x?)dt 


lim v , 1 y i a B-y(v j ,v k ) = y h(t y z), 

,^,7=1 VP 7 {j,k)eSp y 


a,(3, 7=1 








/CLT for Multi-type Particle Systems 


26 


where l 3 ^ is defined as in (5.9) with tp replaced by l a ^. So % N => J2a,p,y=i as 

N —>• oo. Define l from x to M (u (g) v a.s.) as 

K K K 

^ ^ ^ Z a!( 3 7 (u;,u/), {iO,u') € Df" x 

q =1 / 3=1 7=1 

Noting that for all (w,u/) € Df x Df, l a ^ y (u/, u) = l a ^p{u,u'), we have ^ 

Combining the above observations we have as IV —>• oo, 

K 

J N ’ 2 (T) =» Trace(AA*) + £ J 2 ®£) = Trace(AA*) + J 2 (f), 

a,P, 7 =1 

In fact by Lemma 5.3 we have as N —>• oo, under P w , 

(J n,1 (T), J n, 2 (T)) => (I 2 (h sym ),Tmce(AA*) + I 2 (f)). (5.14) 

Recall the function / € L 2 (Q^ x z> ® z>) defined in (3.12). It follows from (5.4) that 

1(oj,oj')= [ h(u", oj)h(uj", u') v{dui"), 

which implies / = 2h sym — l. From (5.14) we get as N —>• oo, 

J N (T) => I 2 (h sym ) - i(TVace(7L4*) + / 2 (f)) = ^(/ 2 (/) - T7ace(AA*)) = J, (5.15) 

where J was introduced in (3.13). In fact from Lemma 5.3 it follows that with ^ as in (5.7), 
and (jy- a > introduced below (5.7), as N —>• oo, 

(£ ^(^),J n (T))^ (£ Ii(^i a) ),J). (5.16) 

We will now use the above convergence result to complete the proof of Theorem 3.1. 


5.2.3. Completing the proof of Theorem 3.1 

It follows from Lemma 1.2 of [18] (cf. Lemma A.l in Appendix A) and Lemma 3.1 that 
E]p(exp(J)) = 1, where IP is as introduced above (3.12). Along with (5.15) and the fact that 
E pJ v(exp(J Ar (T))) = 1, we have from Scheffe’s theorem that exp (J N (T)) is uniformly inte¬ 
grate. Since | exp (* EaeK fa 0 (a) )) | = h 

exp (*^f«W (a) ) + jJV (r)) 
aefO 
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is also uniformly integrable. From (5.16), we have as N —>• oo, 

ex P (* Y 0 (a) ) + jhT ( T )) => exp (i Y J i(^i Q) ) + j)- 

aeK aeK 


Hence, using uniform integrability, 

Jinr^Epiv (exp (* Y ia (^ (Q) ) + jN ( t ))) 
a&K 


— Ep 


ex P (* Y J i(^i Q) ) + J ) 

a£K 


= exp (-^|| {I-A) \Y £»(«**))> 

a£K 

where the last equality is a consequence of Lemma 1.3 of [18] (cf. Lemma A.l in Appendix A) 
and Lemma 3.1. Thus we have proved (5.8), which completes the proof of Theorem 3.1. □ 


5.3. Proof of Theorem 3.3 


It was argued in Section 5.2.3 that Ep(exp(J)) = 1. Consider now the second statement in 
the theorem. Recall the definition of £, N (4>) in (3.11). For (f> € A K , let 




1 

7W == W 


Y ■■■ Y *(*S->**)- 

heATi ik&Nk 


Then P o {f N ((/))) 1 = o (, £ N ((f> )) 1 . Using Lemma 5.3 as for the proof of (5.16), we see 
that under P^, with </> = 0(X*(-),... , X*(-)), as N -» oo, 

exp ( 'i£ N (4 >) + J N (rfj exp (iI K (<t> sym ) + j). 

As before, exp(i£^(0) + J N (T)) is uniformly integrable. Hence as IV —>• oo, 

Ep exp ^ 7V (^)^ = Eqjv exp (^ii N = E p jv exp (i£ N ((j>) + J N (T)^ 

->• % exp ( U K (4 > Sym ) + </) = Eq exp (^I K (Y Vm )^ , 


which finishes the proof. 


□ 


6. Conditions and notations for CLT in the common factor case 

In this section we will present the main condition that is assumed in Theorem 4.2 and also 
introduce some functions and operators needed in its proof. 
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6.1. Assumptions for the central limit theorem 

Consider the systems of equations given by (4.1)-(4.3) and (4.4)-(4.6). Since, unlike the model 
considered in Section 2, here the dependence of the coefficients on the empirical measure is 
nonlinear, we will need to impose suitable smoothness conditions. These smoothness conditions 
can be formulated as follows. 

Denote by J [resp. J\ the collection of all real measurable functions / on R d + m + d [resp. 
R m+d ] that are bounded by 1. Denote by 0 the class of all g : R m x [P(R d )] K R m such that 
there exist c g £ (0,oo); a finite subset J g of J\ continuous and bounded functions g;i),g; 2 ) 
from R m x [7 ? (R‘ i )] A to R mxm and from R m x [T , (M d )] A x R rf to R m respectively; and 9 g : 
R m x [P(R d )] K xR m x [P(R d )] K -)• M m such that for all r = (y, o),r' = (y', i /) € R m x[P(R d )} K 

K 

g( r ') - g{r) = g w (r)(y' - y) + ^(fif( 2 ), 7 (^, •)> K “ v i)) + r '), 

7=1 


and 


where 


K 


"') ~ 9 (r )|| < c g (W - y\\ + ma ? I</(y. 0> K “ 

7 =1 feJa 


\\@g( r i Oil < Cg{\\y' 


y\\ 2 + ~~ 0)l 2 )- 

7=1 fGj3 


Write o' = (<7i,..., a m ) where is an R m -valued function for k = 1,..., m. The following will 
be the key assumptions needed in Theorem 4.2. 


Condition 6.1. b, k = 1,... ,m are in class 0. 


We impose analogous smoothness conditions on b a as follows. 

Condition 6.2. There exist c b £ (0, 00 ); a finite subset J b of J; continuous and bounded 
functions & a ,(i)i ^ 7 ,( 2 ) from R d+m x [T^R^p to R dxm and from R d+m x [T^R^)]^ x R rf to 
R d respectively; and 6 ba : R d+m x [iP(R d )] A ' x R m x [P(R d )] K -> R d such that for all a £ K, 
x £ R d , r = (y, u) and r' = (y 7 , o') £ R m ® 

I< 

b Q (x,r') - b a (x, r ) = b a ^ 1) (x,r)(y' - y) + ^(& Q7 ,( 2 ) (x, r, •), - O) + 6 ba (x,r,r') 

7=1 


and 


K 


II 06a (®> r > Oil < C b{\W - y\? + I 2 /’ ')’ K “ ^7)) 1 2 ) • 

7=1 


( 6 . 1 ) 


The above conditions on b a ,b,cr are satisfied quite generally. For example, let d = m = 1 
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and 

b a (x,y, v) = b afi (x,y,{fi,u),...,{f k ,u)), 
b(y, u) = bo(y, (f k , v)), 

&(y, v) = °o(y, </i, v), ■ ■ ■, (fk, ”)), 

where b at o, bo and cro are bounded twice continuously differentiable functions with bounded 
derivatives; and /) are bounded Lipschitz functions. Then above conditions hold. We refer the 
reader to [3] for details and other examples. 


6.2. Canonical processes 

Recall the canonical space Cl N = Ql m x D4 defined in Section 4.2. We introduce the following 
canonical stochastic processes. 

For co = (tD, cji,<U 2 ,... ,oon) € , let V l (uo) = coi,i € N and V(oj) = Co. As before, abusing 

notation, we write 

V i = (W i ,X i ),i £ AT", V = (W,Y). 

Also with n Q as in Remark 4.1 let p a = LP(lo, W) for a € K and p = (p 1 , ..., p K ). Recall 
¥ n € V(Cl N ) introduced in (4.7). With these definitions, under P v , (4.4)-(4.6) are satisfied a.s. 
for i € N, where pf is the marginal of p a at time instant t; also with Q t = a {Vo, W s , s <t} and 
Q = Qt, Pt = £(X l t\Q) = £(Xi\g t ), t € [0,T], i € N a , a € K, a.s.; and R_is {Qt} adapted. 
Recall the process 14 = (114, A4) defined on Qly in Section 3.1. Also define 14 = (114,14) on 
Ql m as follows: For Co = ( 001 , 002 ) € O m , 

Z (w) = (144(a)), 14 (w)) = (wi,w 2 ). 

Let //“ : —»■ V(Cd) be defined as p*(Co) = LP(Y4o(a>), 114(a))) for a) € and a € K. Note 
that t i->- p^ t is a continuous map, i.e. an element of Cpmd) [0, T], which once more we will 
denote as //“. Finally let p* = (pi,.. .,p*) and D* = (114, Y*, pf). 

6.3. Some random integral operators 

We now introduce some random integral operators, similar to the integral operators introduced 
in Section 3.2, which will be needed to formulate the CLT. Randomness of the integral operators 
is due to the fact that the kernel function of these operators will depend on the common factor. 
Recall b ai ( 2 ) in Condition 6.2. Define function b c a ^ from M d+m x x M. d to as 

follows: For (x,r,x) € R d+m x [P(M. d )] K x with r = (y,u), 

h a 1 ,{ 2 )( x , r , x ) = ft a 7 ,( 2 )(x,r,x) - (b aij ( 2 )(x,r, -),v y ). 

Recall 6 ( 2) j7 and d fc ( 2 ),7 i n Condition 6.1. Similarly, define functions b%, ^ and < 7 £ ^ from 
M m x [^(M^)]^- x M. d to M m as follows: For (r,x) € M m x (P(W l )] K x with r = (y, v), 

6 ( 2 ), 7 ( r ^) = b{2),"t(r,x)- (b(2),y(r,-),vf), 

^fc,( 2 ), 7 (x, x) = d k p )n (r,x) - (d k ^ 2 )^(r, •), vf). 


( 6 . 2 ) 

(6.3) 
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We now introduce another function given on a suitable path space that will be used to define 
the kernels in our integral operators. One ingredient in the definition of this function requires 
additional notational preparation and its precise definition is postponed to Section 7. Define 
for t G [0, T] and ct, 7 € K , the function f ajjt from W l x C R d+ 2 m x pj( R d)]ir[ 0 , i] to M. d as follows: 

For G R d x C R d + 2m x p> (R d)]K [0, i] with d= (w,r) = (w,y, u), 


/a7,t(* (1) .*[o,t]> d [0,t]) = & a7,(2)( x(1) 


Tt, ®i 2) ) + 6 q,( 1 ) (* (1) , r t )s 7)t (x[J ) t] , d [0it] ), 


(6.4) 


where the function s 7ji from C R d+ 2 m x [-p( R d)p [0, t\ to M m will be introduced in Lemma 7.4. 

Recall the transition probability kernel p a introduced below (4.7). Fix Co G D m and con¬ 
sider the Hilbert space , p(Co, •)), where p(Co, duo 1 ,..., duox) = pi(w, duq) <8 >•••(£) 

Pk{Co,(FjOk)- Define for P a.e. u), Iff 7 G L 2 (D^ x FLd,p a (Co, •) x p 7 (u), •)) as 


h°f 7 {uo,J) 



f cry,t (AL,t(w),X Jl , i [o,t](^ ;/ )i^ , *,[o,t]( w )) ' dW* t t( w), 


(co, co ) G x 


Let x fl£,p(ti,-) ® /5(a), •)) be the lifted version of h-T 7 , namely hf 7 { 00 , 00 ') = 

hf 7 (w Q ,wi) for cj = (wi,..., wr-) € and u/ = (c o[,... ,uo' K ) € Define the integral 
operator H ^ 7 on Hq as follows. For g G / Hq and 00 G , 


AZ , 9^)=[ giuj^h^iuj^u;) p{uj,du'). (6.5) 

Let Aoj = J2a 7=1 Then this is the integral operator on associated with the kernel 

ha, = Ea 7 =i ^ T 2 (D^ x fl^,p(uo, •) & p(u), •)). Denote by I the identity operator on 'Hq. 
The following lemma is proved similarly as Lemma 3.1. Proof is omitted. 

Lemma 6.1. For P a.e. Co, (a) Trace(H2) = 0 for all n > 2, and ( b ) I — is invertible. 


Recall the collection A a , a G K introduced in Section 4.2. For a € K, <f> a G A a and to € Q m , 
let 


= <l> a (X*(u)) - m% a (u), oo € n d 

Eg 7 = ((I - A^n, (I - (6.6) 

where is as in (4.8) and <3?g is the lifted function defined as in (3.7), namely for 00 = 
(uq,..., uok) € and a G K. 

$©M = ^S(w Q ) = <t> a (X*{u a )) - m% a (u). (6.7) 

The quantities E^ 7 , cc, 7 € IT were used in Section 4.2 to characterize the limit distribution 
of (Vf^i),..., V^{4>k))- In particular, recall that vr^( 0 i,..., 4>k) is the K -dimensional mul¬ 
tivariate normal distribution with mean 0 and variance-covariance matrix E^ = (E^ 7 ) Q; 7 g x, 
and n((f>i,... ,c/)k) is the Gaussian mixture defined by (4.10). Theorem 4.2, which is proved in 
Section 7 below, says that under Conditions 4.1, 6.1 and 6 . 2 , (Vf^i),..., V^{4>k)) converges 
in distribution to 7 r(</q,... ,4>k)i where {4>i) are as in (4.9). 
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7. Proofs of Theorem 4.2 and related results 

In this section we will present the proof of Theorem 4.2. With {V 1 = (W l ,X l )}i e N,V = (W,Y) 
as introduced in Section 6.2, define Y N as the unique solution of the following equation 

Y t N = Y 0 + f b(Y s N , tf) ds + f d(Y s N , rf) dW s , (7.1) 

Jo Jo 

where , ■ ■ ■ and g] ,N = $ x i f° r 7 £ K. We begin in Section 7.1 

by introducing the Girsanov’s change of measure that is key to the proof. The main additional 
work required for the proof of CLT in the presence of a common factor is in the estimation 
of the difference between Y N and Y. This is done in Section 7.2. These estimates are used 
in Sections 7.3 and 7.4 to study the asymptotics of the Radon-Nikodym derivative. Finally 
Sections 7.5 and 7.6 combine these asymptotic results to complete the proof of Theorem 4.2. 


7.1. Girsanov’s change of measure 


Let R N = (' Y n ,/a n ) and R = (Y,/x). For t G [0,T], define {J N (t)} as 


■N( 


where 


and 




K r t 

J N ’Ht ) = E E / Rs) - ba(Xl Rs)] ■ dWi, 

o=i ieN a 


j N ’\t) = e E /Vo (xi,R?)-b a (xi,R a 

Jo 


' ds. 


(7.2) 

(7.3) 

(7.4) 


o=i ieiv, 


Letting for t G [0 ,T\, = <t{R(s), V l {s) : 0 < s < t,i £ N}, we see that {exp {J N (t))} is a 

{RN {-martingale under ¥ N . Define a new probability measure on fl N by 




= exp (J n (T)). 


dF N 


(7.5) 


By Girsanov’s theorem, (X 1 ,..., X N , Y N , V) has the same probability law under Q N as 
(Z 1,N ,..., Z N,N , U N , V°) under P, where R° is introduced below (4.9). For 4> a € A a , a £ K, 
let 

E MX*) (7.6) 


ieiv Q 


In order to prove the theorem, from the definition of in Section 6.3 and 7r(^>i,..., <\>k) in 
Section 4.2, it suffices to show that 


K r 

IV—>oo E ^' V eXP (® V* (^«)) = / 

o=l 


1 

ex P v 0 

Sir- \ Z 


K 


{I-A*)- 1 E$ 


a=l 


)p(du), 
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which from (7.5) is equivalent to showing 


lim Epjv exp 
N —^oo 


(i E ^(0«) + ~ \j N '\T )) 

a=l 



1 

2 


K 

OL= 1 


2 

L2(nf,p(cs,)) 



The above equality will be established in Section 7.6. 


(7.7) 


7.2. Studying Y N — Y 


The following lemma is an immediate consequence of the fact that for each 7 € K, conditionally 
on Q, X 3 are i.i.d. for j E Nj. Proof is omitted. 

Lemma 7.1. For each 7 E K and r E N, there exists a r E ( 0 ,00) such that for all N E N 

sup Ejpjv|(/(-),(/i7 - pl' N ))\ r < -^ 7 ?- 
II/I|oo<1 NJ 


As an immediate consequence of the above lemma we have the following lemma. 
Lemma 7.2. For each r E N, there exists a r E (0, 00) such that 

CL r 


sup E^ N \\Y t N -Y t \\ r < 
te[0,T] 


N r / 2 ' 


Proof. Fix r E N and t € [0,T], By (4.5), (7.1) and Burkholder-Davis-Gundy inequality, there 
exist ki,k ,2 S ( 0 ,oo) such that 

E fN \\Y t N -Y t \\ r 

<^E fN ( \\b(Rf)-b(R s )\\ r ds + n 1 E pN ( [ \\d{R^) - d{R s )\\ 2 ds) r/2 
Jo Jo 

rt K rt 

<k 2 Epiv / \\Y s n - Y s \\ r ds + K 2 Epiv E / max \(f( Y s,-),(pT N - vlW ds, 

Jo Jo 


where the last inequality follows from the fact that b and a satisfy Condition 6.1. Thus by 
Gronwall’s inequality and Lemma 7.1, V1V E N 


Epiv \\Y t N — Y t 


K ,t 

< K 3 \ / Ejpiv max_ 

Jo f€Jiuj a 


MY„-Un 


7,7V 

s 


hl))\ r ds< 


K 4 

N r / 2 


for some K4 E ( 0 , 00). 


□ 
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The following lemma follows from standard uniqueness results for stochastic differential 
equations (see eg. Theorem 5.1.1 of [11]) and straightforward applications of Ito’s formula. 
Recall the canonical space Fl N from Section 4.2 along with the Borel c-field J- N = B(Fl N ) 
and probability measures F N (see (4.7)). Let denote the canonical filtration on 

(fl N ,X N ). Note that W introduced in Section 6.2 is an m-dimensional (T): V }-BM under P^. 

Lemma 7.3. Let {A t } t £[o,T]> { F t}t£[o,T\> k = lbe continuous bounded adapted 

processes with values in M mxm , given on (Cl N ,T N , F N ). Also let {at}te[o,T]> {ft}te[o,T]> k = 
1 ,m be progressively measurable processes with values in M m such that 

rT m rT 

EpAr / ||a s || 2 ds + Y^Epjv / \\fs\\ 2 ds < oo. 

Jo /, | 40 


Write W = (W 1 ,..., W m ). Then 

(a) The following mxm dimensional equation has a unique pathwise solution: 


pt 171 pt 

$t = Im+ / A s $ s ds + y2 F s®s dWg, 
Jo k=1 Jo 


Vt = Irn - 


pt 171 pt 171 p 

/ * s A s ds-Y / 4^ dW* + V / 
40 k=1 J0 k=1 J0 


*s(F s k ) 2 ds 


(7.8) 

(7.9) 


where I m is the mxm identity matrix. Furthermore, 4 't are mxm invertible matrices a.s. 

and & 

(6) Given a square integrable -measurable random variable Yq, the following m-dimensional 
equation has a unique pathwise solution: 


pt 171 pt 

Y t = Y 0 + ( A S Y S + a s )ds + y2 ( F s F s + /*) dW*. (7.10) 

Jo k=1 Jo 


Furthermore the solution is given as 

rt m rt 


Y t = 4 >, 


Yq+ <h s 1 a s ds + V"' 
40 fc=l' 


m rt 


0 


K'fsdW^-Y, 

k =1 • 


K lF sfsds 


(7.11) 


The following lemma will give a useful representation for Y N — Y, and the function from 
C R d+ 2 m x [p( R m)]if [0, t] to M m introduced in this lemma is used to define the integral operator 
in Section 6.3. Recall the functions gn\, g@) and 0 g introduced above Condition 6.1 and 
centered functions defined in (6.2) and (6.3). Let D = (W,R) = ( W,Y,/j ,). 

Lemma 7.4. For t € [0,T], 


Y 


N 


K 


7=1 


1 


E 

iG N-, 


s i ,t 
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where 


re m rt 

^t(X( 0 >t] ,D m ) = S t / S-'I/^^R^X^ds + Y^Zt / £; l al ( 2 ) jRs.Xi)dW, 

Jo k=1 Jo 


m „ t 

-J2 £ t ^m(RsH t(2 )JRs,xi)ds (7.i2) 

k =1 Jo 

rt 171 rt 

rf(t) = St / £-%(R s ,R?)ds + Y^£t / S-^RsM^dW* 

Jo k=1 Jo 

m . t 

7 1 40 


and £t = £t(-D[o, 4 ]) * s unique solution of the m x m dimensional SDE 

rt m rt 


rt rt 

£t = Im+ / b(i)(R s )£s ds + y ' / &k,(l) (Rs)£i 
Jo k=1 Jo 


s dWg. 


Proof. For t £ [0. T], we have 
Yf - Y t 


m rt 


T ) - b(R s )J ds + J2 (°k(Rs) - dk(Rs)) dWg 

k=i 

rt K 

: / (6 (1) (^)(F/-F s ) + ^(6 {2) , 7 (^,0,(^-/xl))+%(fl s ,flf))d S 

4 ° 7=1 

m K 

+ E / (^,( 1 )(^)(^-n) + •), W ,N -rf)) + M«.> Rs)) dw h s 

k=1 J ° 7=1 


The result is now immediate on applying Lemma 7.3 with Y = Y N — Y, $ = £ and 

K 

A s = b {1] (R s ), a s = J2(b { 2),^Rs, ■), (p]’ N ~ pD) + e- b (R s , R?), 


7=1 

K 

F* = a k){l) (R s ), f k s =J2^k,(2 )n (Rs,-Up]’ N ~ Pi)) +e^ k (R s ,R^), k = l,...,m. □ 

7=1 

Lemma 7.5. For every r £ N, we have sup fg [ 0i T] Ejpjv \\£t || r < oo, sup tg [ 0T ] Ej>iv||£ t _1 || r < oo 
and 

max sup sup Epjv||s 7jt (Xj ?' v D [ot] )\\ r < oo. 
te[o,T] jeN^ L , J 

There exist ao £ (0, oo) such that for all t £ [0,T], 

K 


Ep»|| EfE ' < Z Ef»l|7T v (t)ll 2 < $ 


a o 


-AT/.MI 2 ^ «0 


— N~ 

7=1 r jeJVy 
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Proof. For fixed r € N and t £ [0, T], it follows by the boundedness of b n) and u.m that 
EjpAr 11 St 11 r 


— E P 


piV 


Im + 


ps dWf 


<3 r - 1 ii/ m ir + 


r l ' . r l 

/ ^( 1 ) (-Rs)^s ds + 'y ^ / Ctfc,( 1 ) {Hs)£s 

Jo k=1 Jo 

pt 

(Sty- 1 / Epjv|| 6 ( 1 ) (-Rs)£s|| r ds + (3mi ) r_1 Y'' / Ep^^mCR^r da 

io , , Jo 


m rt 


<k± Epjv||E s || r ds + k\. 

Jo 

By Gronwall’s inequality, 


sup Epjv \\£t || r < oo. 
te[o,T] 


Using Lemma 7.3, it follows by a similar argument that, for each r € N 

sup Efjv||£ t -1 || r < oo. 
te[o,T] 


(7.13) 


(7.14) 


From (7.12), (7.13), (7.14), and boundedness of 6 ( 2 ) ■) <J - ( 2 ) ■> a - (ip it follows now that for each 
7 €K, 

sup sup Epiv||s 7 i t(Xf otl ,D [o, t] )ir<oo. 

te[o,T]j£N 7 

Once again, by boundedness of and (7.13), (7.14), we get that 

K 


i i r l 

¥7? E E f * / £7 l si,mP R ‘’ x i)4wi 

1 . ' iV 7 7\r 40 


7=1 7 j£N-f k =1 


m ft . 

<(Ep.||^|| 4 ) 1/2 (E fw ||^ / C'EaT E °h2)^ R s,Xi)dW h s 

k= 1 7=1 J 7 j£N-f 


4\ 1/2 


m pt JX 1 

'E / e f»(|I £ ’ 7 1 II 4 |E w E 7 ,( 2 ), 7 (H..x|) 

fe=i 1/0 7=1 J 7 


< k 2 


4 \ 1 V 2 

ds 


m ft if , 

<k 2 [E / (Ep„ IIS ," 1 II s ) 1/2 (e,„ II E jv" E 

fc=l ,/0 7=1 7 j'GlV- 


^,(2),7 


8 ^ 1/2 -| 1/2 
ds 


< 

AT’ 


where the last inequality is from Lemma 7.1. Similarly, by boundedness of 6 ( 2 ),.,c r -,( 1 ), <T -,( 2 ),. 
and Lemma 7.1, we have that 


Ep 


piV 


Elf E( £ < / ET% ) „i.R.,Xi)4* 

7=1 7 ieA^ 1/0 

m 

E^ J Q ^~ 1 ^,(l)(^)^,(2), 7 (- R S > X s)^ 


< 


K 4 

iV' 
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Combining the above two observations and recalling the definition of s 7j t from (7.12), we have 


Eo, 


K 1 

X 7v~" X 


— N~ 

7=1 ’ j£N- 


< m 

- N' 


A similar argument using Condition 6.1, (7.13), (7.14), Lemmas 7.1 and 7.2 shows that 
Ejpjv||7^ iV (t )|| 2 < The result follows. □ 


7.3. Asymptotics of J N,1 (T) 

In this section we analyze the term J NA (T) defined in (7.3). Recall 5 a7 = {(*, k) E N a x 1V 7 : 
i / k} dehned in Section 5.2.2 for a, 7 € K. 

Lemma 7.6. 

E 

0 , 7=1 7 (i,j)es a ~, 
where —>• 0 in probability under F N , as N —>• 00 . 

Proof. Note that for each a E K and i E N a , 

b a (Xi,R?)-b a (Xi,Rt) 

= 6 a>(1) (A*, Rt)(^ - y t ) + f>o 7 ,(2) (Xi,Rt, •), (mX - ^)) + K (XI, Rt, R?). (7 ' 15) 

7=1 

For the last term in above display, we have 

%4XX [ T 0 ba (X l t ,RuR?)-dWi) 2 

K a=lieN a Jo ' 

* rT 

= XX / 

a =i Jo 

K 'jp 

- Kl XX [ ®P»\\Y t N -Y t fdt 

0=1 i£N a 

/C 'J 1 

+ «i X X X / E^|(/(A*,y t ,-),(/i7 ,iV -^))l 4 ^ 

a,-y=iieN a feJ b Jo 

< f ^ 0, (7.16) 



where the hrst inequality is from (6.1) and the last inequality follows from Lemmas 7.1 and 7.2. 
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Now consider the second term on the right side of (7.15): 
K rT K 


EE / E<W)( x t’^’-),(^ ,JV -^))-^ 

a=li G jV„ 0 7=1 

E [ T b c n{ 2)( x lR>,x’)-d w t + '£w- £ [ T <Z*,m(xl' R <,xt)-<wt 

<,7=1 7 (i.n)GS^ a =1 “ i£lV„ 1/0 


“, 7=1 ' (i,j)GSa 7 

Using the boundedness of fr.. : ( 2 ) it follows that, 

f 

ieN, 


%»(£jL £ 

o=l a i£N„ 


Finally consider the first term on the right side of (7.15). It follows from Lemma 7.4 that 

K j' 

EE / 

0=1 ieiVc* "'° 

K r JT' 

= E^ E / 

a, 7=1 7 (i,j)£S a -y 

K r £' 

+ E]f E / &a,(l)W>-Rt)*a )t ( 4 it] ,^[O lt ])-dW? 

0=1 " V " ieATo " / ° 

K 


+ EE f b °,(R (X' t ,Rt)Tf{t).dWi 
:7Z 4o 


0=1 ielV Q 

By boundedness of b. m and Lemma 7.5, we have 

/c j* 


HIE E / 

o=iieiv a • y ° 


dWi 


< 


«3 

N ’ 


and 


ii ^ ^ 

EatE / & a,(l)(^^f) s o,t(A'[ 0 jt] ,D[ 0>t ]) 

1 ... i JY o » r JO 


• dlU) 


< 

- IV' 


0=1 “ i£N a 

Result now follows by combining above observations and recalling / a7 t dehned in (6.4). □ 


7.4■ Asymptotics of J N,2 (T) 


In this section we analyze the term J N,2 (T) dehned in (7.4). We will need some notations. 
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Let x € Cd and z = (a^ 1 ), x^ 2 \ d) € C R 2 d+ 2 m x [-p( R d)]K [0, T) with d = ( w,r ) = ( w,y,v). 
Define for a, /?, 7 € K , functions s a p lt i, i = 1,2,3, and s a p 7 from C R 3 d+ 2 m x pr,( R d)p [0, T] to R 
as follows: 

r T 

s Q ^,i(x,z) = / b a ^(x t ,r t )sp jt (x^ t] ,d[ 0tt ]) ■ b ai ^(xt,r t )s lit (x^ t yd[ 0 jt ])dt, 

nT 

s a ^, 2 (x,z) = J ^ • b c ai {2) (x t ,r t ,xi 2) ) 

+ 6 ai (i)(x t ,n)s 7) t(®jJ],d [M ) • dt , 

f T 

s a ^, 3 (x,z)= / blp ^ix^r^xP) ■ b c a7 {2) (x t ,r t ,x[ 2) )dt, 

•J 0 
3 

^a/3"fi. x , z ) ^ Sg/3'Y,i(.X, z'). 


„( 2 ) 


(7.17) 

(7.18) 


i=l 

Note that 

r T 

s cxj3'i{ x , z ) — J f a/3,t ( x t , ^[0^] > ^[0,t]) ' f ari,t (-^t ’ ®[0,t] ’ ^[0,t]) dt-, 
where / Q( g it is as in (6.4). Define m a( g 7 : C R 2 d+ 2 m x pc>( R d)]A:[ 0 , T] —>• R as 

■m afil {z) = J^ f a/3tt {x', d [0it] ) • f ai y{x', x^, d [0)t] ) v a ,t( dx ') dt ’ C 7 - 19 ) 

and let : C R 3 d+ 2 m x [p( R d)]x[ 0 , T] -> K be given as 

^a[3ry(. x i z ) z ) '^ J Oi/3'y^ z ) • 

Recall D introduced above Lemma 7.4. The following lemma gives a useful representation for 
J N ’ 2 (T). 

Lemma 7.7. 


K 


J N ’ 2 (T)= £ 


IV. 


if 


IV. 


^ NN E m^ 7 (^',X fe ,D>)+ 2 E m Qry (^',^',Z>)+^, 

“,/3,7=l ^ 7 (L fc )s5 / 3 7 a,7 =1 7 j'6JV 7 

where 1Z 2 —>• 0 in probability under P^, as IV —>• oo. 

Proof. Note that for each a £ K and i € AT a , 

||6 a (^.-Rt v )-M^,-Rt)ll 2 

K 

b a ,(i){Xi, Rt)(Y t N - Y t ) + J2(bay,(2)(Xi,R t , •), (^E - M 7 )) + 0 ba (Xi, Rt, R?) 


7=1 


K 


\K,(1)(XI Rt)(Y t N - y t )|| 2 + ^( 6 Q 7 ! ( 2 )(x t \ i* t , ■), (rt’ N - m 7 )) + ||<? 6a {Xl Rt, R 


f)ll 2 


7=1 


K 


+ 2b aM (Xl,R t )(Y t N - Y t ) • ^(fr a 7 , { 2 ) {X\,Rt, ■), W’ N ~ rt)) + 

7=1 


(7.20) 









/CLT for Multi-type Particle Systems 


39 


where consists of the remaining two crossproduct terms. Using (6.1), Lemma 7.1 

and 7.2, as for the proof of (7.16), we see that 


K , T 

/ PbAxiRt,R?)fdt< 

,v-1 7\T -JO 


«1 

N 


0 as IV —y oo. 


(7.21) 


a=l 2 EAT q 

Similar estimates together with Cauchy-Schwarz inequality show that 

K 


%EE / I r 2 N ’\t)\dt< 

a=li£N a 


H2 

Vn 


0 as N —y oo. 


(7.22) 


Next we study the first term on the right side of (7.20). Using Lemma 7.4, we have 


\\b a!{1) (Xl,R t )(Y t N -Y t 


I< 


W^MEtt E ^Ax{ 0 , v o m ) + Ti 

7=1 7 jeN-y 

K 1 2 

b<l) (Xl,R t )J2 W E 8 -yA x [o,t]’ D M) +\\b Q , {1) (XlRt)T 1 N (t))\\ 2 + T 3 N '\t), 
7=1 1Vt jeJV 7 

where T^ )l {t) is the corresponding crossproduct term. Making use of the boundedness of 6. (1) 
and Lemma 7.5, we can show that 

K T 

%-EE / 

0=1 jeAT a Jo ' 

%*E E / t |^wi^< 

0=1 ieJVc " /o 

Thus recalling the definition of s aj g 7) i, we have 
K 

EE / ||6 a , (1) (^, J R t )(y t iV -r t )|| 2 dt 

o=l jeATo, "'° 

K T K 

E E / M(4s.)Ef E 

o=l if-Nm 7=1 7 7'GJV-v 


K 4 

\/jv’ 


o=l *GlV Q 
K 


dt + Ki (7.23) 


o=l iGATq 
K 


E 


^ JV«jV 7 ^ 

o,/9,7=1 7 i£Ncx,j&Ni3,keNy 

where EpjvlTt^l —> 0 as iV —>• oo. 


E s Q ^ 1 (X i ,X^,X fc ,U>) + ^ 


iv 
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We now consider the second term on the right side of (7.20). Recalling the definition of 
s a/? 7 , 3 , we have 


E E r|E(W)«^,). W -, ? )> 


a=U£N a J0 " 7=1 
K 


dt 


E i E 


(7.24) 


a„3,7 : 


' =1 iV/3^ 


s aPl ^X\X\X k ,D). 




Finally we consider the crossproduct term on the right side of (7.20). Using Lemma 7.4, 


K 


K 


E E 26 Q , (1) (x t \i7 t )(y^-y f )-E(W)( x ^^’0,(^’ JV -^)) 


a=l zGATq 


7=1 


« 2 

E jW\T E 

:,/ 9 , 7=1 " ° 7 i&N a ,j£Nf3,k£N.y 


K 


+ E E (^d)^,^)^^)-— e b c a7j(2) (xi, R t ,xf 

a, 7=1 i£N a 

= Tf(t) + T 5 N (t). 


keN-y 


Using boundedness of 6 . ( 1 ), 6 .. ( 2 ), Lemma 7.1, 7.5 and Cauchy-Schwarz inequality, we see that 


Etp 


ipiV 


/ T |7f(t)| 

Jo 


dt < —= -> 0 as JV -> 00 . 

Vn 


For the term 1~ 4 N (t), recalling the dehnition of s Q( g 7i2 and using elementary symmetry proper¬ 
ties, we have 


/ji ^ 

I rf(t)dt= E 

7o 


1 


,(9,7=1 ieN a ,jeNp,keN-, 


E s a ^ 2 {X\X\X k ,D). 


Thus we have 
K 


K T K 

EE / 26 Q!(1) (y^i7 t )(y^-yo-E(W)(^^^-),(/iE-^))^ 

O^lieiVa 0 7=1 


E E ^ 7)2 (X i ,^,W fc ,U>)+^, 

, 0 , 7=1 ^ 7 i&N a ,j£Np,k£Ny 


(7.25) 


where 77^ —>• 0 in probability as TV —> 00 . 
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Combining (7.20) - (7.25) and recalling the definition of s aj g 7 in (7.17), we have 

K 1 

J N ’\T)= Y E s afh (x',x’,x k ,D) + 'R» 

a,/3, 7=1 ^ 7 i£N a ,j£Np,k£N y 

= E £ ^ / 3 7 (XhX^X fe , J D) + 7^3 ¥ (7.26) 

a,/3,7=l V/3 7 i£N a ,j£N,3,k£N y 

K at k n 

+ E vir E m <&y( xi ' x *’ D )+ E ivl E m <m( xi < x ’< D )< 

«i/3,7=1 13 7 ( 'j,k)eSp y a,7=1 7 

where m a ^ 7 is as defined in (7.19) and 7^ —>• 0 in probability as iV —>• oo. From the 
boundedness of second moment of (which follows from Lemma 7.5), conditional inde¬ 
pendence of X i ,X^, X k for distinct indices i G N a ,j G Np,k G 1V 7 , and the fact that for all 
(X,£) € C R 3d+2m x [-p( R d)]if[0,T] 

^ sC a p 1 (X\x^ ) ,x (2 ' l ,d) =Ep N s c a/3l (x,X :i ,x ( - 2 \d [0 j ] ) = % N s^(x, x w , X k , d) = 0, 

it follows that the first term on right side of (7.26) converges to 0 in probability as IV —» oo, 
which completes the proof. □ 


7.5. Combining contributions from J N,1 (T ) and J N,2 (T ) 


In this section we will combine Lemmas 7.6 and 7.7 to study the asymptotics of the exponent on 
the left side of (7.7). Recall m a( g 7 defined in (7.19) and canonical maps X *, Y*, W .*, and Z2* 
defined in Section 6.2. For fixed Co G Q m , define functions l E 7 £ L 2 (^d x p a (to, •) x / 0 7 (w, •)) 
as 


Y'W) = 


An 


VAgX 


zTn a / 3 ^(X%(ujf X%(lo ),LL(ca)), (oo^uo ) G 12^ x 12^. 


(7.27) 


Let fE 7 S x Qj ,p(uo, •) x p(w, •)) be lifted versions of , namely 

u ; = (wi,.. .,wk) € 12^,u/ = (u/ l5 ... ,uo' K ) G , 

and let Ijj = i7E 7 - Recall p and functions tiff introduced in Section 6.3. It follows 

from (7.18) and (7.19) that for a, a' , (3 ,7 G -K” and w = ( 07 ,..., w^), u/ = {uo\ ,..., w^) G 12^, 


f 

■' Q d 


h°f{uo", u)h% 7 (u/', u/) /3(w, dw") 


l{o=o'} yr— 7 — / / ( f a/3,t(X* ) t {^ a )i ( w )) 

JQs 40 V 


W^7 •'Ri •'O 

/a 7 ,t ( X *,i( w a) > -**,[0,t] (w 7 ) , i?*, [ 0 ,t] (w) )) dt (w , dw; 

A 


L {ct=(Y'} ‘ 


= l{a=a^E 7 <Y,u/). 


X * D* (Cc?)) 


(7.28) 
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Thus, with ho as in Section 6.3, 

lo(w,u')= / ho (w",w) ho(u}",u') p(u,(kj"). 

Jn? 


(7.29) 


Recall the integral operators Aff 1 defined on PLo introduced in Section 6.3. Then for a, a ', 
/3, 7 E K, the operators A^f (A? 7 )* : PLo —>■ Plo are given as follows: For g E PIq and a; € 

(A-Z 1 )* g{u) = f ( [ ho P (u\u)ho^{u\Lj'') p(u,du')^g(uj") p(u,du") 

= !{«=<*'} [ io ,3l (u,u")g{u”) p{u,du"), 

where the last equality is from (7.28). In particular, we have Aff^AP 1 )* = 0 if a 7 ^ a'. 
Moreover, it follows from the display in (7.28) that for a,/ 3,7 E K, 


Tvace(Af(A^y 


/ 
J n 


n d xn d 


Ar 


( W ; dw ) /5( W ; <^0 

*(w)) p(w, duj') 


•x/A/jXy ./wy 

l{ i 3 = 'y}T — / TTl a <yry (AC* (CUM , AC* (tJj) , -D * ((U ) ) p 7 (w, did A , 

A 7 


(7.30) 


where the last equality holds because of the centered terms in the definition of s 7 y in (7.12) and 
the definition of s a pry in (7.17). Thus Trace^T 3 ^^ 7 )*) = 0 if (3 7 ^ 7 . Define r : D m —»• R as 
r(u>) = Trace (tI^HJ), where Ao is the operator introduced below (6.5). The following lemma 
is immediate from the above calculations. 


Lemma 7.8. 


K AT 

E jv? E m„^Xi,Xi,D) 

0,7=1 7 j£N .y 


in probability under as N —>• 00 . 


r(R) -> 0 


Proof. Note that for fixed oj E D m , 

r(a>) = Trace (Ao A*t) = Trace ((EE^kEE^ 7 )*) = EE Trace ( Aff 1 (Aff 1 )*). 

ol =1 7=1 ot=l 7=1 a=l 7=1 

It suffices to show for each pair of a, 7 E K, 

^ £ m a 77 (X^,X^L>)-Trace(^(^ 7 )*) 

7 j(zN~/ 

converges to 0 in probability as N —>• 00 . However, this property is immediate from (7.30) and 
the law of large numbers, since m^XX 3 , XP t D) is square integrable and conditional on Q, 
{Xyj E IV 7 } are i.i.d. with common distribution p^(V, •) o Xf 1 . □ 
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We will now use the results from Section 3.5 with § = and v = p(Co,-),Co E Q m . For 
each Co E Cl m , k > 1 and / E L 2 sym (p(uj, -)® fc ) the MWI I%(f) is defined as in Section 3.5. More 
precisely, let A k be the collection of all measurable / : x (Qd) k —> R such that 

/ |/(w,wi,... ,u k )\ 2 p(ui,duji)... p(u,doo k ) < oo, P a.e. d) 

•W) fc 

and for every permutation 7r on {1,..., fc}, /(d), uj i,..., w*,) = /(d), ..., oo n ^\), P <g) p® k 

a.s., where P <8> p® k (dCo, duoi ,..., du^) = P(dCd) nf=i P(^’; duoj). Then there is a measurable 
space (O*,^ 7 *) and a regular conditional probability distribution A* : fl m x J’ E [0,1] such 
that on the probability space (fi m x Q*,B(H m ) <g) J 7 *, P (g) A*), where 

P®X*(AxB) = [ X* (Q,B) P(dCo), Ax B £ B(Q m )®P*, 

J A 

there is a collection of real valued random variables {/&(/) : / E k > 1} with the properties 
that 


(a) For all / E A 1 the conditional distribution of I\{f) given Q* = B(H m ) <g) {0,O*} is 
Normal with mean 0 and variance Jqk f 2 (Co, oo) /5(d), duo). 

a 

( b ) 1^ is (a.s.) linear map on A k . 

(c) For / E of the form 


/(w,wi,...,w fc ) = n h(uj,LOi), s.t. / h 2 (u}, co) p(oo, duo) < oo, P a.e. oo 


i —1 

we have 

Lfc/2J 

W)(fi,u*) = ^2(-iyc k ,. 

j =0 

and 






h 2 (co,u) p(uo, duo )) (/i(/i)(w,u;*)) fc 2j , P®\* a.e. (oo,oo*) 


(Ik{f)(oo,oo*)) 2 X* (co, duo*) = kli / h 2 (oo, u) p(u, duo)) , P a.e. u, 




where C k ,j are as in (3.9). We write I k (f)(ui,-) as I k (f). With an abuse of notation, we will 
denote once more by F* the canonical process on x f2*, i.e. F*(d),u;*) = d), for (d),w*) E 


x n* 


From Lemmas 7.6, 7.7 and 7.8 it follows that 

1 


J n (T ) = J N ’\T ) - -J N,2 {T) =S N - -r(F) + 7^, 


where 


5 ^ 



(X*,Xf 0)t]) I? [0it] ).dW? 

m afh (Xi,X k ,D), 


(7.31) 
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and 1Z N —>• 0 in probability as N —>• oo under P N . 


Define F : x x D* —> M as follows: For (cD,u;,u/) € x x D*, 

F(uj,uj,uj') = hu(oj,u]') + hu{oJ,tu) - Iq{uj,uj') 

= hu(tjj,u}') + h&(u}', u) - / hQ(uj",u)ha,(<jj", uj') p(u, dw"), 

where the second equality is from (7.29). Note that F e A 2 and so F(F) is a well defined 
random variable on (D m x D*, , P®\*). Recall the collection A a , a € K, introduced 

in Section 4.2. For <f a € A a , m< <p ry is defined as in (4.8). For such a <f a € A a , ^&§(cu) is as 
defined in (6.7). We denote : Q m x -4® as «3>“(u),u;) = l>g(w), namely for O € and 
u = (uq,.. .,ujk) e Df, 


4>“(w,w) = 4>g(w) = (f> a (X*(uj a )) ~ m^ a {io). 

Note that <l“ € .4 1 and so 7i($“) is well defined. Let for <f a € A a , V& (<j> a ) be as in (7.6). From 
the definition of Q and Q* it follows that there are maps and L from D m to F , (R A+1 ) such 
that 


C 


^((vf^r),...,®^),^) 


L N (V), a.s., 
L(V*), P® A* a.s. 


From conditional independence of {X 1 } it follows using Lemma 5.3 that 


Ln(u) —» L(u) weakly, for P a.e. ui. 


(7.32) 


Define r : D m x fi* -> ® as t(u,u*) = Trace(7l^7li). The following lemma is the key step. 
Lemma 7.9. As N — >• oo, i Yla=i W>a) + J N1 {T) — \J N ' 2 (T) converges in distribution to 
^a=lhm + \HF)-\f. 


Proof. Note that from (7.31), 

i E + j7V,1 ( r ) - = i E W&O + s N - \t{V) + n N , 

a=l a =1 


where TZ N —» 0 in probability as N —> oo. Let Z^r and l from 

K- 

W) = £ (i E V^(0a) + S" - -r(F)|g), 


CK— 1 

K 


i(VA = c(iY j i 1 ^ a ) + \h{F)-\f 


a=l 


G* , 


to T’(C) be such that 
P^ a.s., 

P ® X* a.s. 


It follows from (7.32) and definition of r, f that 

Zat(w) —» Z(w) weakly, for P a.e. Q. 

The desired convergence is now immediate on combining above observations. 


□ 
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7.6. Completing the proof of Theorem f.2 


It follows from Lemma 1.2 of [18] (cf. Lemma A.l in Appendix A) and Lemma 6.1 that P a.s. 


E 


P <g>A* 


exp ( -I 2 


= exp (^Trace(%(%)*)). 


Recalling the definition of t below (7.32) it follows that 


E P®A* 


1 1 

exp ( -h{F) ~ -t 


= 1 . 


Also, recall that 


Eip 


p N 


exp ( J N ’\T) - l -J N ’ 2 


= 1 . 


Using Lemma 7.9 along with Scheffe’s theorem we now have as in Section 5.2.3 that 

K 


lim Es 


TV—>■ oo 


pJV 


exp 


^E^(^) + JjV,1 ( T )- l jN ’ 2 


ot=l 

K 


— ®P(g>A* 


— ^PigiA* 


exp (iJ2hm + \l 2 (F)-±f 
a=l 


K 


^PigiA* 


e xp(i^/i($“) + i/ 2 (F)- K) 

a=1 


1 K 

exp ( - j IK 1 - 4s)" 1 ^211 1 - 


ollL2(nf,p(<s,.)) 


a=l 


P(o;), 


where the last equality is a consequence of Lemma 1.3 of [18] (cf. Lemma A.l in Appendix A) 
and Lemma 6.1. Thus we have proved (7.7), which completes the proof of Theorem 4.2. □ 


Appendix A: A lemma on integral operators 

The following result is taken from Shiga-Tanaka [18]. Let § be a Polish space and v € V(S). 
Let a(-, •) € L 2 (n <S> v) and denote by A the integral operator on L 2 (v) associated with a: 
Acj)(x) = f Rd a(x, y)<fi(y) v{dy) for x € M. d and 4> € L 2 (v). Then A is a Hilbert-Schmidt operator. 
Also, AA*, and for n > 2 , A n , are trace class operators. The following lemma is taken from [18]. 

Lemma A.l. Suppose that Trace(A n ) = 0 for all n > 2. Then E[e 2 /2 ^*] = e 2 Trace U L4 ) ; 
where f(x, y) = a(x, y) + a(y, x ) — f Rd a(x, z)a(y, z) u{dz), and I 2 {-) is the MWI defined as in 
Section 3.5. Moreover, I — A is invertible and for any </> € L 2 (z/) ; E[exp(i/i(<^>) + \l 2 (/))] = 
exp[—^(||(7 — A)^ 1 (f)\\ 2 L 2 ^ — Trace(AA*))] ; where I is the identity operator on L 2 (v). 
















/CLT for Multi-type Particle Systems 


46 


Appendix B: Proof of Lemma 5.2 


Let / be a bounded Lipschitz function from M. d to R such that ||/||oo < 1 and ||/||l < 1, where 
|| • ||l is the Lipschitz norm. Then 

|E Po /(U-E P '/(r?)| 

< |Ep 0 /(£n) - Ep 0 /(^ mn )| + |E P 0 f{imn) ~ ^P 0 f(Vm)\ + |Epj,/0?m) ~ ^P Q f(v)\ 

< 2supE Po (||4 - £ mfc || A l) + |E Po /(£ mn ) - E r J(^ m )\ + 2E P j i (||r? m - rj\\ A l). 

fc>i 

Letting n —> oo gives us 

limsup|E Po /(£ n ) -E r J(r))\ 

n—>• oo 

< 2supE Po (||£fc - ^ mfc || A l) + limsup |E Po /(^ mn ) - E P > f{r) m )\ + 2 E P / ) (||? 7 m - rj || A l) 

k> 1 n—> oo 

= 2 supE Po (||^fc - ^ m fe|| A 1) + 2E P / (||? 7 m - rj\\ A l). 
k> 1 

The result now follows on sending m —>• oo. □ 
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